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Description 

[0001] The present invention is related to the recordal, processing, storage and playback of bitstreams, particularly 
audio and/or visual (audio/visual) bitstreams. Three general aspects are described. 
5 [0002] Firstly, the indexing of points in such recorded bitstreams is described, particularly in relation to the bookmak- 
ing of specific points, and to the use of regularly spaced index points in the performance of operations on such recorded 
bitstreams. 

[0003] Secondly, the synchronisation of conditional access information with respect to such recorded bitstreams is 
described. 

10 [0004] Thirdly, a command set for control of operation on such a recorded bitstream is described. 

[0005] The present invention relates to a method of facilitating the searching of a file, a method of searching a file, 
a table, a file comprising a representation of a bitstream and a table, a storage means, a hard disk video recorder, a 
receiver/decoder, and a broadcast system. 

[0006] The invention finds particular, but not exclusive application to the location and retrieval of data from recorded 
15 bitstreams, particularly variable bitrate bitstreams, and particularly programmes recorded under the control of a receiv- 
er/decoder. 

[0007] Such recordal and retrieval of data, in particular, is described International Patent Application No. PCT/ 
IB01/01845 in the name of Canal+Technologies Societe Anonyme, whose content is herein incorporated by reference. 
[0008] The present invention also relates to apparatus for evaluating a position in a bit stream, apparatus for manip- 
20 ulating a bit stream, a method of evaluation a position in a bit stream, a method of manipulating a bit stream, a receiver/ 
decoder, a broadcast system incorporating such apparatus, a computer program product, a computer readable medium, 
and a signal embodying the above computer program product. 

[0009] The invention finds particular, but not exclusive, application in processing digital bit streams. This invention 
has more particular use in the recording phase of bit stream manipulation. 
25 [0010] The invention also relates to a command for controlling the transfer of an audio/visual bit stream, a command 
set incorporating such a command, an operating system, a receiver/decoder, a computer program product, a computer 
readable medium, a signal tangibly embodying such a computer program product, apparatus for processing audio/ 
visual data, an audio/visual processing device, a broadcast system, and a method of controlling the reproduction of 
an audio/visual bit stream. 

30 [0011] The invention finds particular, but not exclusive, application in providing functionality in a receiver/decoder 
for digital television. 

[0012] Digital television systems transmit television channels to the viewer in digital, ratherthan analogue, form. The 
digital channels are encoded into a digital data stream at the transmitter end, and are decoded at the receiver end 
using a digital receiver/decoder. To allow interactivity, an uplink may be provided, either via the same medium that 
35 delivers the television channels, or else via a different medium such as a telephone link. Further types of data, such 
as digital audio, software and interactive data can be or are also broadcast. As used herein, the term "digital television 
system" includes for example any satellite, terrestrial, cable and other system. 

[0013] The term "receiver/decoder" as used herein may connote a receiver for receiving either encoded or non- 
encoded signals, for example television and/or radio signals, preferably in MPEG format, which may be broadcast or 

40 transmitted by some other means. The term may also connote a decoder for decoding received signals. Embodiments 
of such receiver/decoders may include a decoder integral with the receiver for decoding the received signals, for ex- 
ample, in a "set-top box", such as a decoder functioning in combination with a physically separate receiver, or such a 
decoder including additional functions, such as a web browser, a video recorder, or a television. 
[0014] The term MPEG refers to the data transmission standards developed by the International Standards Organ- 

45 isation working group "Moving Pictures Expert Group" and in particular but not exclusively the MPEG-2 standard de- 
veloped for digital television applications and set out in the documents ISO 13818-1 , ISO 13818-2, ISO 13818-3 and 
ISO 1 381 8-4. In the context of the present patent application, the term includes all variants, modifications or develop- 
ments of MPEG formats applicable to the field of digital data transmission. 

[0015] Generation, storage, transmission and processing of files containing representations of bitstreams, for in- 
50 stance variable bitrate bitstreams, is well known in the field of digital technology. However, it can be difficult and inef- 
ficient to locate desired portions of such files, corresponding for instance to particular time offsets in an associated 
bitstream, particularly without decoding or decompressing such files. 

[0016] In known systems, searching a file, for instance for data corresponding to a particular time offset in the bit- 
stream, is generally done iteratively, typically by assuming that the bitstream has a constant bitrate. The assumption 
55 that the bitstream has a constant bitrate is generally rather crude, and searching a file in this way is time consuming 
and inefficient, and indeed may make processes dependent upon the location of specified points in a file or associated 
bitstream impossible, or difficult and inefficient. Such processes may be, for instance, fast-forwarding, rewinding, skip- 
ping, bookmarking points in a file, controlling access to portions of a file, or analysing characteristics of a file or bitstream 
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as a function of time or data offset. 

[0017] DVDs can contain separate files which contain data offsets corresponding to points in the DVD file corre- 
sponding to the start of chapters. However, there is generally a limited number of chapters in a DVD file, and conse- 
quently a limited number of reference points, and such reference points are generally not directed to mapping time 
5 offsets. Such data offset files are of little use in searching for particular points in a file, other than the start of chapters. 
[0018] The present invention seeks to remedy problems encountered with the above prior art. 
[0019] Accordingly, there is provided a table comprising at least one record mapping a respective data offset in a 
file containing a representation of a bitstream to a corresponding time offset in the bitstream. 

[0020] Thus, data in a file corresponding to a particular time offset in the bitstream may be accessed rapidly, and 
10 efficiently. 

[0021 ] As used herein the term "bitstream" preferably connotes data comprising a series of bits arranged, for instance, 
temporally. The term bitstream is used interchangeably with the term datastream. A bitstream may comprise audio/ 
visual data or be representative of such audio/visual data, or it may comprise, or be representative of, teletext infor- 
mation, subtitles, any other type of text information, numerical information, or computer data, including computer pro- 
fs grammes. 

[0022] Digital and satellite TV transmissions generally comprise at least one bitstream comprising audio/visual data 
or a representation of such data. However, data transmitted or stored in or between any digital device, for instance 
computer devices, processors, A/D convertors, televisions, HDVRs, or storage devices for instance hard disks, tapes, 
computer storage devices, CDs, or DVDs may comprise a bitstream or a representation of a bitstream. 
20 [0023] A time offset may be the offset in time of a particular point in a bitstream from a defined point, for instance 
the start of the bitstream. A data offset in a file may be a position in memory in relation to a defined position, for instance 
the start of a file. If a bitstream is stored as file comprising a series of bits in a memory, then the data offset may be 
the number of bits from the start of the file, for instance. 

[0024] As used herein the term "table" preferably connotes data comprising at least one data point. A table may map 
25 such at least one data point to at least one other data point of the same or different type, directly or indirectly. A table 
may be in the form of a database, spreadsheet, or a file stored for instance in an electronic data storage device, for 
instance a hard disk, floppy disk, CD, DVD, or optical storage device, or a non-electronic storage device, for instance, 
a print-out. The term "table" as used herein may also connote an algorithm or process for generating such data point 
or points. 

30 [0025] Preferably, the table comprises at least one data point representing a respective at least one data offset in a 
file containing a representation of a bitstream and at least one data point representing a corresponding at least one 
time offset in the bitstream. Thus, the table may map directly a respective data offset to a corresponding time offset, 
and the value of the respective data offset and/or the corresponding time offset, may be obtained quickly and efficiently. 
[0026] Alternatively, the table may comprise at least one data point representing a respective at least one data offset 

35 in a file containing a representation of a bitstream, and the table may map the respective at least one data offset to an 
entry in a further table, and this entry in the further table may be, or may map to, a corresponding at least one time 
offset in the bitstream. 

[0027] Alternatively, the table may comprise at least one data point representing a respective at least one time offset 
in a bitstream, and the table may map the respective at least one time offset to an entry in a further table, and this 
40 entry in the further table may be, or may map to, a corresponding at least one data offset in a file containing a repre- 
sentation of a bitstream. 

[0028] In particular, audio/visual data may be in the form of a bitstream representative of a frame or series of frames. 
Such a bitstream may comprise a series of bits representative of pixels or points in such frames. A film or other sequence 
of moving images may comprise a series of frames, and each frame may be representative of a different image. As- 
45 sociated audio information, and indeed other information, such as conditional access or entitlement information, may 
also be included in such bitstreams. 

[0029] Preferably, the value of the at least one respective data offset and/or the at least one respective time offset 
is chosen in dependence upon a characteristic of the bitstream and/or the representation of the bitstream. 
[0030] Preferably, the bitstream is a variable bitrate bitstream. 
50 [0031] Thus, data in a file corresponding to a particular time offset in the bitstream may be accessed rapidly and 
efficiently, even if there is not a linear relationship between data offset throughout the file and time offset throughout 
the bitstream. 

[0032] As used herein, the term "variable bitrate bitstream" preferably connotes a bitstream comprising a series of 
bits representative of data which may vary with a parameter, for instance time or location, and for which the number 
55 of bits representative of one portion of the data at a particular value or range of values of the parameter may be different 
to the number of bits representative of another portion of data at another value or range of values of the parameter. 
[0033] So, for instance, if a bitstream comprises a series of bits representative of an image frame, and the number 
of bits required to represent a portion of this image, for instance a foreground object, is greater than the number of bits 
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required to represent another portion of the image, for instance a plain background, then the bitstream may be a variable 
bitrate bitstream and the data offset in the bitstream, or in a file containing a representation of such bitstream, may not 
vary linearly with a spatial offset in the image frame itself. 

[0034] In a bitstream comprising, for instance, a series of bits arranged temporally, the bitrate may be the number 
5 of bits per unit time in the bitstream, and a variable bitrate bitstream, may then be a bitstream in which the number of 
bits per unit time may vary with time offset. 

[0035] If a bitstream comprises a series of bits representative of a series of periodically spaced, time-varying image 
frames, for instance a film, and the number of bits necessary to represent one frame is less than the number of bits 
necessary to represent another frame then the bitstream may be a variable bitrate bitstream, and a data offset in a file 

10 containing a representation of the bitstream may not vary linearly with a time offset in the bitstream, or in the film itself. 
[0036] Such variable bitrate bitstreams may comprise compressed or encoded digital data (or representations of 
such data), such as data transmitted to, stored at, or generated by HDVRs, or indeed any video or audio device, such 
as devices included in, or associated with a set top box, or computers, processors or mass storage devices, such as 
a hard disks, or DVDs. Such variable bitrate bitstreams may include data in a variety of compression formats, including 

15 MPEG-2, MPEG-4, MP3 protected by different ciphering or encoding algorithms including DVB-CS, DES, 3DES, and 
may contain video and or audio data, teletext information, subtitles, any other type of text information, superimpose 
data, computer data, or representations of such data. 

[0037] As used herein, the terms "enciphering", "encoding", and "encrypting" are preferably to be understood to be 
used interchangeably. Similarly, the terms "deciphering", "decoding", and "decrypting" are preferably to be understood 
20 to be used interchangeably. 

[0038] In fact, bitstreams including data in many, if not all, industry-standard compression or encryption formats, 
including those mentioned above, may intrinsically have variable bitrates. 

[0039] For instance, many compression formats use techniques which map changes to reference data from onetime 
period to another, rather than producing independent data sets for each time period. In particular, M PEG data includes 
25 key frames, which can be used to regenerate a portion of data, particularly audiovisual data, for instance a frame in a 
film, independently of other portions of data in the bitstream, and delta frames which map changes from associated 
keyframes. The bitrate associated with keyframes in the bitstream would generally be higherthan the bitrate associated 
with delta frames. 

[0040] The term "key frame" as used herein preferably connotes a portion of data which can independently be used 
30 to regenerate a respective further portion of data, independently of any other portion of data. Typically the respective 
further portion of data is audiovisual data, and the key frame may typically be included in a bitstream. 
[0041] A key frame may, for instance, independently be used to regenerate image data for display on a screen, for 
instance a particular scene in a film. 

[0042] The term "keyframe" may be contrasted with the term "delta frame", which as used herein preferably connotes 
35 a portion of data which can be used to regenerate a respective further portion of data, in dependence upon another 
portion of data. Typically the said another portion of data is a key frame, and the delta frame maps changes from this 
key frame. 

[0043] For instance a film may comprise a series of images which are displayed consecutively on a screen. Data 
representing one image may be in the form of a key frame, and the image may be regenerated from the key frame 

40 independently of any other portion of data. 

[0044] Data representing subsequent images may be in the form of delta frames, and these images may be regen- 
erated from the delta frames in dependence upon the key frame. Typically the delta frames would map changes in the 
images from the image represented by the key frame data. A bitstream may comprise a series of keyframes interleaved 
in time with series of delta frames mapping changes from the preceding key frame. 

45 [0045] Under MPEG-2 protocol, video data comprises a series of keyframes, known as intraframes (l-frames) inter- 
leaved with interframes (P-frames) and bidirectional frames (B-frames), both of which can be classed as delta frames 
according to the use of this term above. An interframe (P-frame) maps changes from the preceding frame, whereas a 
B-frame maps changes from either or both preceding and following frames. The interleaving of the P-frames and B- 
frames with the l-frames is dependent upon the encoder, and need not be regular. 

so [0046] If the file is encoded, then preferably the at least one record maps a data offset in the encoded file to a 
corresponding time offset in the bitstream. 

[0047] Thus, the searching of a file for data at particular time offsets, or corresponding data offsets, is enabled without 
the need to decode the file, thus preserving security measures and increasing efficiency of access to data. 
[0048] Such encoded files may include files subject, for instance, to any combination of compression and encryption 
55 processes, such as MPEG-2 and DVB-CS or MP3 and 3DES for instance. 

[0049] Preferably, the table comprises at least three records, and the time offsets are periodic. 

[0050] Thus periodically spaced points in time in the bitstream may be accessed quickly and efficiently, enabling 

quick, smooth and efficient operation of time-dependent processes such as skipping, fast-forwarding and rewinding. 
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[0051 ] Periodic time offsets may be located in particular parts of the bitstream, for instance chapters, or throughout 
the whole bitstream, with at least one period. 

[0052] Preferably, the period of the time offsets is varied. Thus the speed of processes such as searching, fast- 
forwarding, rewinding, or skipping may be varied. 

5 [0053] A period may vary throughout the bitstream, or parts of the bitstream and may vary with time. Periodicities 
may be varied by a user, or may be varied automatically in response, for instance, to a user's behaviour or to the 
characteristics of a bitstream, or to the characteristics of data, for instance audio/visual data, represented by the bit- 
stream. Generally, a period would remain the same throughout a particular file track, or programme. 
[0054] For instance, if a particular bitstream comprises a representation of a film, then index points may be inserted 

10 in a table corresponding to portions of the bitstream with a high bitrate, which may, for example, be associated with 
action sequences in a film. Alternatively, the table may be updated and, for instance, points may be inserted corre- 
sponding to a particular portion of a bitstream automatically if a user performs a large number of operations corre- 
sponding to that portion of the bitstream, for instance fast forwarding, pausing or rewinding. Such time offsets may 
also be inserted at a user's request. 

15 [0055] In addition, time offsets and data offsets may correspond to other preferred points in the file or associated 
bitstream, such as the start or end of chapters. 

[0056] Preferably, the period of the time offsets is chosen to match a characteristic of the bitstream, and is preferably 
0.5, 1 , 2 or 1 0 seconds. 

[0057] In the case of an MPEG-2 bitstream for instance, key frames may occur with a frequency of 2 Hz, and thus 
20 if time offsets of index points are chosen with a period of 0.5 seconds, the index points may correspond to the key 
frames. Similarly, if the frequency with which key frames occur in a bitstream varies, the period of the time offsets of 
the index points can vary so that index points and key frames coincide. 

[0058] The period of the time offsets can also be chosen to match other characteristics of the bitstream. 
[0059] Furthermore, the period of the time offsets may be chosen in dependence on a characteristic of the stored 
25 representation of the bitstream, and preferably in dependence on the size of a cryptoperiod. 

[0060] Preferably, the bitstream comprises at least one portion of bitstream data which can independently be used 
to regenerate a respective at least one portion of audiovisual data, and the time offset of the at least one record cor- 
responds to the respective at least one portion of bitstream data. 

[0061] Such portion of data may be a keyframe, for instance in an MPEG bitstream, and or may be representative, 
30 for example, of a background image, or overlay image. Such portion of data may be accessed directly and immediately, 
and representative output of audio/visual data may be obtained rapidly at different points throughout the bitstream. 
[0062] Preferably, the at least one portion of bitstream data comprises a key frame. 

[0063] Preferably, the bitstream comprises MPEG data, and the at least one portion of bitstream data comprises an 
intra-frame. 

35 [0064] Preferably, the bitstream comprises at least one further portion of bitstream data which can be used to regen- 
erate a portion of audiovisual data in conjunction with the at least one portion of bitstream data, and preferably the at 
least one further portion of bitstream data comprises a delta frame. 

[0065] Thus smooth, rapid, and efficient operation of processes such as fast-forwarding, rewinding and skipping can 
be enabled. The potential maximum speed of these operations may also thus be increased, as the speed with which 
40 key frames can be located may be increased, and as there may be no need to process dependent portions of data, 
such as delta frames, or only a limited number of such dependent portions of data may need to be processed. 
[0066] It may be that the representation of the bitstream is encoded, and preferably the at least one record in the 
table is mapped to decoding data. 

[0067] Such decoding data may comprise a plurality of pieces of decoding data, each adapted to decode a respective 

45 portion of the encoded representation of the bitstream. 

[0068] Preferably, the table may comprise a plurality of records each mapping a respective data offset in a file con- 
taining a representation of a bitstream to a corresponding time offset in the bitstream, and each record may be mapped 
to respective decoding data for decoding a respective portion of the encoded representation of the bitstream. 
[0069] Furthermore, the representation of the bitstream may comprise at least one piece of data mapping to decoding 

50 data and/or may comprise decoding data. 

[0070] Preferably, in decoding a stored representation of a bitstream, reference may be made to data within the 
stored representation of the bitstream itself and/or to data stored in, or mapped by, a table as described herein 
[0071] Such decoding data may be a key or control word, and may itself be encoded and may require a further key 
to be decoded. Various encoding data, including conditional access or content management information, may be en- 

55 coded and stored. The encoding, decoding and storage of conditional access information and content management 
information, and the use of conditional access information and content management information in the storage and 
retrieval of data, particularly bitstream data is discussed in detail in International (PCT) Patent Application No. PCT/ 
IB01/01845, the contents of which are herein incorporated by reference and any part of which may combined in any 
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appropriate combination with any feature or combination of features described herein. 

[0072] Preferably, the table is generated automatically during recordal of the representation of the bitstream in the file. 
[0073] Thus, no further processing of the recorded bitstream is necessary after recordal of the bitstream is complete, 
and the HDVR index table is in place even if the recording is interrupted or terminated. 
5 [0074] Preferably, at least one record in the table is mapped to a respective at least one further record, and preferably 
the said at least one further record comprises conditional access information or content management information. 
[0075] Decoding data may comprise, or may be included in, such further record. 

[0076] Content management information orconditional access information may be, for instance, a control word (CW), 
or CMMs, ECMs, EMMs, URMs, or associated information, which may be associated with data located at a particular 

10 value or range of values of data offset or time offset. Typically, the bitstream may be divided into time segments, or 
cryptoperiods (encompassing a range of time offsets), and the further record may be associated with a particular 
cryptoperiod or plurality of cryptoperiods. The further record may also be associated with, for instance, chapters, or 
with files as a whole, or with particular users or groups of users. Access to data may be enabled rapidly and efficiently 
by reading stored related information corresponding to particular data offsets or time offsets. Such rapid access to data 

15 may be particularly important in respect of processes such as fast-forwarding, rewinding, or skipping. 
[0077] In particular, the further record may comprise a CMM or plurality of CMMs. 

[0078] If the point in the table maps to a data offset in a file which does not correspond to the start of a cryptoperiod, 
then the HDVR would generally not have access to the CMM, or a pointer to such CMM, or other content management 
or conditional access information, necessary to decode the data at that point. The HDVR would typically have to read 

20 consecutively forward or backward through the file in order to find the next set of such information or pointer to such 
information in order to begin decoding data. By mapping at least one record in the table to at least one further record, 
conditional access or content management information applicable to the point in the file indexed by the record can be 
provided, and data from this point can be decoded immediately, without first having to read through the file to find such 
information. This feature is of particular advantage if data at a number of points in a file needs to be read consecutively 

25 and rapidly, for instance in performance of certain trick mode operations, such as fast forwarding or rewinding. 

[0079] The further record may also comprise, for instance, comments, which could be displayed on a screen, or 
commands, such as television control commands. Alternatively, the data could be related to a parental control mech- 
anism. Such parental control mechanism may be directed to particular chapters, but may also be directed to cryptope- 
riods and pluralities of cryptoperiods, and user defined portions of a file. 

30 [0080] The further record may be stored in the table of records, or in a separate file or table, or the table of records 
and or the related information may be stored with the file, for instance in a header. 
[0081] Preferably, the said at least one further record is stored in a further table. 

[0082] The entries in such a further table may be mapped easily to entries in the table mapping data offsets to time 
offsets. 

35 [0083] Preferably, the said at least one further record is inserted upon command of a user. 

[0084] Thus, a user may add, or indeed remove, information relating to characteristics of a programme or a bitstream. 

For instance, a user may select particular scenes within a recorded film to which they wish to control access, and such 

access could be controlled by addition or amendment of a record activating a parental control mechanism. 

[0085] Preferably, the said at least one record in the table is mapped to the respective at least one further record 
40 upon command of a user. 

[0086] Thus, a user can control which records are associated with which further records. 

[0087] Preferably, the file is encoded and the at least one record maps a data offset in the encoded file to a corre- 
sponding time offset in the bitstream. 

[0088] Preferably, at least one record is inserted in dependence upon a characteristic of the bitstream. 
45 [0089] Preferably, at least one record is inserted upon command of a user. 

[0090] Thus, points in a file may be bookmarked by a user for ease of access. 

[0091 ] The records may be inserted, or indeed deleted or modified, by a user 'on-the-fly 1 , whilst, for instance, viewing 
a programme, or reading a file, or may be inserted in the file at points corresponding to user-specified intervals through- 
out the bitstream. 

so [0092] Preferably, at least one record comprises a first data point representing a respective data offset and a second 
data point representing a corresponding time offset. 
[0093] Preferably, at least one record is inserted automatically. 

[0094] Thus, the user may bookmark particular parts of the bitstream of interest without having to review the file or 
the bitstream, in whole or part, directly or indirectly. For instance, a user may bookmark parts of a film a representation 
55 of which is stored in a file containing a representation of a bitstream, without having to view the film. 

[0095] Particular types of data, or a portion of the bitstream where, for instance, the ratio of data to time in the 
bitstream is within a certain range (which may correspond, for instance, to action sequences in a film, or to scenes in 
a film with highly contrasting images, such as explosions, or lightning strikes) may be located and bookmarked. 



6 



EP 1 286 351 A2 



[0096] Preferably, the table is adapted for storage in a file with the representation of the bitstream. 
[0097] Thus the file and associated table may be easily, for instance, stored, processed or transmitted together. For 
example, the table may be generated at a broadcast centre and transmitted with the file, and thus an HDVR, or other 
device, may be able to read the table and use the information contained within it, without requiring the capability to 
5 generate the table itself. Also, the broadcaster may retain centralised control over files and associated tables. 

[0098] The table may also be generated and or stored at an HDVR, or within any device included in, or associated 
with a set top box, or within any device adapted to read digital data. 

[0099] In a related aspect of the invention, there is provided a method of facilitating the searching of a file containing 
a representation of a bitstream, comprising generating a table as aforesaid. 
10 [0100] In particular, there is provided a method of facilitating the searching of a file containing a representation of a 
bitstream, comprising generating a table comprising at least one record mapping a respective data offset in a file 
containing a representation of a bitstream to a corresponding time offset in the bitstream. 

[0101] Preferably, the value of the at least one respective data offset and/or the at least one respective time offset 
is chosen in dependence upon a characteristic of the bitstream and/or the representation of the bitstream. 
15 [0102] As before, the bitstream is preferably a variable bitrate bitstream. 

[0103] Preferably, the table comprises at least three records, and the time offsets are periodic. 

[01 04] If the time offsets are periodic, then their period is preferably chosen to match a characteristic of the bitstream , 

and is preferably 0.5, 1 , 2 or 10 seconds. 

[0105] Preferably, the period of the time offsets is chosen in dependence on a characteristic of the stored represen- 

20 tation of the bitstream, and preferably in dependence on the size of a cryptoperiod. 

[0106] Preferably, the bitstream comprises at least one portion of bitstream data which can independently be used 
to regenerate a respective at least one portion of audiovisual data, and the time offset of the at least one record cor- 
responds to a respective at least one of portion of bitstream data. The at least one portion of bitstream data could 
comprise a key frame, such as an intra-frame if the bitstream comprises MPEG data, for example. 

25 [01 07] As before, preferably the bitstream comprises at least one further portion of bitstream data which can be used 
to regenerate a portion of audiovisual data in conjunction with the at least one portion of bitstream data, and the at 
least one further portion of bitstream data may comprise a delta frame. 

[01 08] Preferably, the table is generated automatically during recordal of the representation of the bitstream in the file. 
[0109] The representation of the bitstream may be encoded, and preferably the at least one record in the table is 
30 mapped to decoding data. 

[0110] Preferably, the decoding data comprises a plurality of pieces of decoding data, each adapted to decode a 
respective portion of the encoded representation of the bitstream. 

[0111] Preferably, the table comprises a plurality of records each mapping a respective data offset in a file containing 

a representation of a bitstream to a corresponding time offset in the bitstream, and each record may be mapped to 
35 respective decoding data for decoding a respective portion of the encoded representation of the bitstream. 

[01 1 2] Preferably, the representation of the bitstream comprises at least one piece of data mapping to decoding data. 

The decoding data may comprise, or be included in, at least one further record, and preferably the said at least one 

further record may comprise conditional access information or content management information. 

[0113] Again, at least one record in the table may be mapped to a respective at least one further record, and preferably 
40 the said at least one further record comprises conditional access information or content management information. 

[0114] Preferably, the said at least one further record is stored in a further table. 

[0115] As before, the said at least one further record is inserted upon command of a user. 

[0116] Preferably, the at least one record in the table is mapped to the respective at least one further record upon 
command of a user. 

45 [0117] Preferably, the file is encoded and the at least one record maps a data offset in the encoded file to a corre- 
sponding time offset in the bitstream. 

[0118] Preferably, at least one record is inserted in dependence upon a characteristic of the bitstream. 
[0119] Preferably, at least one record is inserted upon the command of a user. 

[01 20] Preferably, at least one record comprises a first data point representing a respective data offset and a second 
50 data point representing a corresponding time offset. 

[0121] Preferably, at least one record is inserted automatically. 

[01 22] Preferably, the table is stored in a file containing the representation of the bitstream. 

[0123] In a further aspect, there is provided a method of searching a file containing a representation of a bitstream 
for a desired portion of data, comprising the steps of jumping to a position in thefile, and reading data from this position, 
55 for example until the desired portion of data is found. 

[01 24] This can provide a more efficient way to find a particular point in a file than alternative methods which advance 
through the file bit-by-bit until the desired point is reached, for example. 

[0125] Preferably the step of reading data comprises reading until the desired portion of data is found, and/or reading 
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a fixed amount of data, and/or reading an amount of data representative of a fixed period of time, and/or reading data 
until a particular piece of data is read. 

[0126] Again, preferably the bitstream is a variable bitrate bitstream. 

[01 27] Thus, a particular point in a file can be found more efficiently than using methods which advance through the 
5 file bit-by-bit until they reach the desired point, for example, even if there is not a linear relationship between data offset 
in the file and time offset in the bitstream. 

[0128] Preferably, the desired portion of data is representative of bitstream data which can independently be used 
to regenerate a further portion of data 

[0129] The further portion of data may, for instance be audiovisual data, and the desired portion of data may be a 
10 key frame. 

[0130] Preferably, the step of jumping to a position in the file comprises reading a record from a table as herein 
described and jumping to the data offset given in the record. 

[0131] Preferably, the step of jumping to a position in the file comprises reading a record from a table as herein 
described and jumping to the data offset given in the record, and an at least one further record is used in the step of 
15 reading data. 

[0132] The at least one further record may be conditional access information, or content management information, 
and may in particular be a CMM or a plurality of CMMs. The further record may be used to decode the data in the file. 
[0133] Preferably, the data offset in the record corresponds to the desired position in the file. 
[01 34] Thus the desired point can be found by jumping to the point in the file corresponding to the data offset in the 

20 file, without the need to read additional data before locating the desired point in the file. 

[0135] Preferably, the step of reading data comprises decoding the data. Furthermore, the step of reading the data 
may comprise reading a record from a table as aforesaid and decoding the data using the decoding data. 
[0136] In a further aspect, there is provided a method of searching a file containing a representation of a bitstream 
for a plurality of desired portions of data, comprising searching for each desired portion of data using a method as 

25 described herein. 

[01 37] Thus a series of desired points in the file can be located quickly and efficiently, and data at these points can 
be read. 

[01 38] Preferably, the desired portions of data are representative of portions of bitstream data which are periodically 
spaced in time. 

30 [0139] Thus, portions of the bitstream which are equally spaced in time can be located and read quickly and efficiently, 
which may enable quick and efficient performance of trick mode operations, such as fast forwarding or rewinding, on 
the stored bitstream. 

[0140] Preferably, the desired portions of data are used to effect a fast forwarding or rewinding operation. 
[0141] The desired portions of data may be located and read, typically using associated CMMs, and the resulting 
35 data, usually audiovisual data, may be output to a display device. 

[01 42] Preferably, the time period between the portions of bitstream data represented by the desired portions of data 
is chosen to effect a given fast-forwarding or rewinding speed. 

[01 43] Preferably, the time period between the portions of bitstream data represented by the desired portions of data 
is chosen in dependence upon a characteristic of a means used to carry out the method. 

40 [0144] The maximum rate at which data may be located, read and displayed by a means, such as an HDVR in 
conjunction with a display device, is dependent upon characteristics of such means, and may be dependent upon 
either hardware or software characteristics. A given fast forwarding or rewinding speed, for instance, may only be 
sustainable if a certain proportion of the data in the stored file is played back. For instance, it may not be possible to 
play back all data in the file at a faster than normal rate. On the other hand, if the proportion of data which is played 

45 back is limited too severely, image quality for instance may be degraded. 

[0145] Preferably, the characteristic is the maximum sustainable rate of retrieval or processing of data from the file. 
[01 46] By varying the time period between the portions of bitstream data, the maximum sustainable rate of retrieval 
or processing of data from the file can be obtained, for given characteristics of the means. Thus, for instance, the 
optimum picture quality may be obtained for a given fast forwarding or rewinding speed. 

50 [0147] Preferably, the characteristic is a read/write hard disk access time, or a parsing demultiplexer bandwidth, or 
an operating system scheduling accuracy. 

[0148] Preferably, the given fast-forwarding or rewinding speed is varied upon command of a user. 
[0149] In a further aspect of the invention, there is provided a method of retrieving at least one desired portion of 
data from a file containing a representation of a bitstream, comprising searching for the desired portion of data using 
55 a method as aforesaid, and retrieving the desired portion of data. 

[01 50] Preferably, the method is a method for retrieving a plurality of desired portions of data from a file, comprising 
searching for each desired portion of data using a method according as aforesaid, and retrieving each desired portion 
of data in turn. 
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[0151] In another aspect of the invention, there is provided a method of outputting data, comprising retrieving at least 
one desired portion of data from a file containing a representation of a bitstream using a method as aforesaid, and 
outputting the at least one desired portion of data. 

[0152] In a yet further aspect of the invention, there is provided a method of outputting data, comprising retrieving a 
5 plurality of desired portions of data using a method as aforesaid, and outputting each desired portion of data in turn. 
[01 53] Preferably, each of the plurality of desired portions of data is representative of a respective portion of bitstream 
data, and the respective portions of bitstream data are periodically spaced in time and/or have the same duration. 
[01 54] Another aspect of the invention provides a method of effecting a fast forwarding or rewinding operation com- 
prising outputting data as aforesaid. 
10 [0155] In a further aspect of the invention, there is provided a file, comprising a representation of a bitstream, and a 
table as described herein. 

[0156] The invention also provides an index table comprising indices mapping time offsets in a bitstream to data 
offsets in a file. 

[0157] In a further aspect of the invention there is provided a method of generating at least one record the method 
15 comprising mapping a respective data offset in a file containing a representation of a bitstream to a corresponding time 
offset in the bitstream. 

[0158] Preferably the representation of the bitstream is encoded and/or the bitstream is encoded. 
[0159] Preferably, the method comprises generating at least one data point representing a respective at least one 
data offset in a file containing a representation of a bitstream and at least one data point representing a corresponding 
20 at least one time offset in the bitstream. 

[0160] Alternatively, the method may comprise generating at least one data point representing a respective at least 
one data offset in a file containing a representation of a bitstream, and mapping the respective at least one data offset 
to an entry. The method may further comprise mapping this entry to a corresponding at least one time offset in the 
bitstream. 

25 [0161] Alternatively, the method may comprise generating at least one data point representing a respective at least 
one time offset in a bitstream, and mapping this respective at least onetime offset to an entry. The method may further 
comprise mapping this entry to a corresponding at least one data offset in a file containing a representation of a bit- 
stream. 

[01 62] Preferably, the method comprises choosing the value of the at least one respective data offset and/or the at 
30 least one respective time offset in dependence upon a characteristic of the bitstream and/or the representation of the 
bitstream. 

[0163] Preferably, the method operates on a variable bitrate bitstream, or a representation of such a bitstream. 
[0164] Preferably the method comprises mapping a data offset in an encoded file to a corresponding time offset in 
the bitstream. 

35 [0165] Preferably, the method comprises generating at least three records, and preferably generating records with 
periodic time offsets. 

[01 66] Preferably, the method comprises varying the period of the time offsets. 

[0167] Preferably, the method comprises choosing the period to match a characteristic of the bitstream, and prefer- 
ably to be 0.5, 1 , 2 or 10 seconds. 

40 [0168] Furthermore, the method may comprise choosing the period of the time offsets in dependence on a charac- 
teristic of the stored representation of the bitstream, and preferably in dependence on the size of a cryptoperiod. 
[0169] Preferably, the method operates on a bitstream which comprises at least one portion of bitstream data which 
can independently be used to regenerate a respective at least one portion of audiovisual data, and the time offset of 
the at least one record corresponds to the respective at least one portion of bitstream data. 

45 [0170] Such portion of data may be a keyframe, for instance in an MPEG bitstream, and or may be representative, 
for example, of a background image, or overlay image. Preferably, the at least one portion of bitstream data comprises 
a key frame. Preferably, the bitstream comprises MPEG data, and the at least one portion of bitstream data comprises 
an intra-frame. 

[0171] Preferably, the method operates on a bitstream comprising at least one further portion of bitstream data which 
50 can be used to regenerate a portion of audiovisual data in conjunction with the at least one portion of bitstream data, 
and preferably the at least one further portion of bitstream data comprises a delta frame. 

[0172] It may be that the representation of the bitstream is encoded, and preferably the method maps at least one 
record to decoding data. The method may comprise generating or obtaining such decoding data. 
[01 73] Preferably, the method comprises generating or obtaining a plurality of pieces of decoding data, each adapted 
55 to decode a respective portion of the encoded representation of the bitstream. 

[01 74] Preferably, the method comprises operating on, or generating , a plurality of records each mapping a respective 
data offset in a file containing a representation of a bitstream to a corresponding time offset in the bitstream, and 
mapping each record to respective decoding data for decoding a respective portion of the encoded representation of 
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the bitstream. 

[0175] Furthermore, the method may comprise operating on a representation of the bitstream comprising at least 
one piece of data mapping to decoding data and/or may comprise decoding data. The method may comprise identifying 
and/or reading such decoding data. 
5 [0176] Preferably, the method comprises referring to data within the stored representation of the bitstream itself and/ 
or to other data. 

[0177] Preferably, the method comprises generating a record automatically during recordal of the representation of 
the bitstream in the file. 

[01 78] Preferably, the method comprises mapping at least one record to a respective at least one further record, and 
10 preferably the said at least one further record comprises conditional access information or content management infor- 
mation. Such conditional access information or content management information may be stored or generated by the 
computer program product itself. 

[0179] Decoding data may comprise, or may be included in, such further record. 

[01 80] Typically, the bitstream may be divided into time segments, or cryptoperiods (encompassing a range of time 
15 offsets), and the method may comprise associating a further record with a particular cryptoperiod or plurality of cryp- 
toperiods. 

[0181] In particular, the further record may comprise a CMM or plurality of CMMs. Preferably, the method may com- 
prise generating or storing such CMM or CMMs. 

[01 82] The method may also comprise generating a further record comprising, for instance, comments, which could 
20 be displayed on a screen, or commands, such as television control commands. 

[01 83] The method may comprise storing the further record in a table of records, or in a separate file or table, and/ 

or the table of records and or the related information may be stored with the file, for instance in a header. 

[0184] Preferably, the method includes the step of storing said at least one further record in a further table. 

[0185] Preferably, the method comprises receiving a command of a user, and the said at least one further record 
25 may be inserted upon receipt of such command. 

[0186] Preferably, the method comprises mapping the said at least one record to the respective at least one further 

record upon command of a user. 

[0187] Preferably, the method comprises generating a record that maps a data offset in an encoded file to a corre- 
sponding time offset in the bitstream. 
30 [0188] Preferably, the method comprises inserting at least one record in dependence upon a characteristic of the 
bitstream. 

[0189] Preferably, the method comprises inserting at least one record upon command of a user. 

[01 90] Preferably, at least one record comprises a first data point representing a respective data offset and a second 

data point representing a corresponding time offset. 

35 [0191] Preferably, the method comprises inserting at least one record automatically. 

[0192] Preferably, the method comprises storing at least one record in a file with the representation of the bitstream. 
[0193] In a further aspect of the invention there is provided a computer program product (in this case and in subse- 
quent cases typically in the form of one or more software modules), comprising means for generating at least one 
record mapping a respective data offset in a file containing a representation of a bitstream to a corresponding time 

40 offset in the bitstream. Preferably the representation of the bitstream is encoded and/or the bitstream is encoded. 

[0194] The computer program product may comprise means for performing a certain action or actions (for instance 
as aforesaid). Each of these means may comprise computer code, for instance one or more software modules as 
aforesaid. 

[01 95] Preferably, the computer program product comprises means for generating at least one data point represent- 
45 jng a respective at least one data offset in a file containing a representation of a bitstream and at least one data point 
representing a corresponding at least one time offset in the bitstream. 

[01 96] Alternatively, the computer program product may comprise means for generating at least one data point rep- 
resenting a respective at least one data offset in a file containing a representation of a bitstream, and the computer 
program product may comprise means for mapping the respective at least one data offset to an entry, and this entry 

50 may be, or may map to, a corresponding at least one time offset in the bitstream. 

[01 97] Alternatively, the computer program product may comprise means for generating at least one data point rep- 
resenting a respective at least one time offset in a bitstream, and may comprise means for maping the respective at 
least one time offset to an entry, and this entry may be, or may map to, a corresponding at least one data offset in a 
file containing a representation of a bitstream. 

55 [0198] Preferably, the computer program product comprises means for choosing the value of the at least one re- 
spective data offset and/or the at least one respective time offset in dependence upon a characteristic of the bitstream 
and/or the representation of the bitstream. 

[0199] Preferably, the computer program product is adapted to operate on a variable bitrate bitstream and/or a rep- 
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resentation of such a bitstream. 

[0200] Preferably the computer program product comprises means for mapping a data offset in the encoded file to 
a corresponding time offset in the bitstream. 

[0201] Preferably, the computer program product comprises means for generating at least three records, and for 
5 generating records with periodic time offsets. 

[0202] Preferably, the computer program product comprises means for varying the period of the time offsets. 
[0203] Preferably, the computer program product comprises means for choosing the period to match a characteristic 
of the bitstream, and is preferably 0.5, 1 , 2 or 1 0 seconds. 

[0204] Furthermore, the computer program product may comprise means for choosing the period of the time offsets 
10 in dependence on a characteristic of the stored representation of the bitstream, and preferably in dependence on the 
size of a cryptoperiod. 

[0205] Preferably, the computer program product is adapted to operate on a bitstream which comprises at least one 
portion of bitstream data which can independently be used to regenerate a respective at least one portion of audiovisual 
data, and the time offset of the at least one record corresponds to the respective at least one portion of bitstream data. 
15 [0206] Such portion of data may be a keyframe, for instance in an MPEG bitstream, and or may be representative, 
for example, of a background image, or overlay image. Preferably, the at least one portion of bitstream data comprises 
a key frame. Preferably, the bitstream comprises MPEG data, and the at least one portion of bitstream data comprises 
an intra-frame. 

[0207] Preferably, the computer program product is adapted to operate on a bitstream comprising at least one further 
20 portion of bitstream data which can be used to regenerate a portion of audiovisual data in conjunction with the at least 
one portion of bitstream data, and preferably the at least one further portion of bitstream data comprises a delta frame. 
[0208] It may be that the representation of the bitstream is encoded, and preferably the computer program product 
is adapted to map at least one record to decoding data. Decoding data may be included in the computer program 
product, or the computer program product may be adapted to generate such decoding data. 
25 [0209] Such decoding data may comprise a plurality of pieces of decoding data, each adapted to decode a respective 
portion of the encoded representation of the bitstream. 

[0210] Preferably, the computer program product comprises means for operation on, or generation, a plurality of 
records each mapping a respective data offset in a file containing a representation of a bitstream to a corresponding 
time offset in the bitstream, and means for mapping each record to respective decoding data for decoding a respective 
30 portion of the encoded representation of the bitstream. 

[021 1 ] Furthermore, the computer program product may comprise means to operate on a representation of the bit- 
stream comprising at least one piece of data mapping to decoding data and/or may comprise decoding data. The 
computer program product may comprise means for identifying and/or reading such decoding data. 
[0212] Preferably, the computer program product comprises means for referring to data within the stored represen- 
ts tation of the bitstream itself and/or to other data. 

[0213] Preferably, the computer program product is adapted to generate a record automatically during recordal of 
the representation of the bitstream in the file. 

[0214] Preferably, the computer program product comprises means for mapping at least one record to a respective 
at least one further record, and preferably the said at least one further record comprises conditional access information 
40 or content management information. Such conditional access information or content management information maybe 
stored or generated by the computer program product itself. 
[0215] Decoding data may comprise, or may be included in, such further record. 

[0216] Typically, the bitstream may be divided into time segments, or cryptoperiods (encompassing a range of time 
offsets), and the further record may be associated with a particular cryptoperiod or plurality of cryptoperiods by the 
45 computer program product. 

[0217] In particular, the further record may comprise a CMM or plurality of CMMs. Preferably, such CMM or CMMs 
may be generated or stored by the computer program product. 

[0218] The computer program product may also comprise means for generating a further record comprising, for 
instance, comments, which could be displayed on a screen, or commands, such as television control commands. 
50 [021 9] The computer program product may comprise means for storing the further record in a table of records, or in 
a separate file or table, and/or the table of records and or the related information may be stored with the file, for instance 
in a header. 

[0220] Preferably, the computer program product is adapted to store said at least one further record in afurthertable. 
[0221] Preferably, the computer program product comprises means for receiving a command of a user, and the said 
55 at least one further record may be inserted upon receipt of such command. 

[0222] Preferably, the computer program product comprises means for mapping the said at least one record to the 
respective at least one further record upon command of a user. 

[0223] Preferably, the file is encoded and the computer program product comprises means for generating a record 
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that maps a data offset in the encoded file to a corresponding time offset in the bitstream. 

[0224] Preferably, the computer program product comprises means for inserting at least one record in dependence 
upon a characteristic of the bitstream. 

[0225] Preferably, the computer program product comprises means for inserting at least one record upon command 
5 of a user. 

[0226] Preferably, at least one record comprises a first data point representing a respective data offset and a second 
data point representing a corresponding time offset. 

[0227] Preferably, the computer program product comprises means for inserting at least one record automatically. 
[0228] Preferably, the computer program product comprises means for storing at least one record in a file with the 
10 representation of the bitstream. 

[0229] In a further aspect of the invention there is provided apparatus for generating at least one record mapping a 
respective data offset in a file containing a representation of a bitstream to a corresponding time offset in the bitstream. 
Preferably the representation of the bitstream is encoded and/or the bitstream is encoded. 

[0230] Preferably, the apparatus comprises means for generating at least one data point representing a respective 
15 at least one data offset in a file containing a representation of a bitstream and at least one data point representing a 
corresponding at least one time offset in the bitstream. 

[0231] Alternatively, the apparatus may comprise means for generating at least one data point representing a re- 
spective at least one data offset in a file containing a representation of a bitstream, and the means for mapping the 
respective at least one data offset to an entry. The apparatus may further comprise means for mapping this entry to a 

20 corresponding at least one time offset in the bitstream. 

[0232] Alternatively, the apparatus may comprise means for generating at least one data point representing a re- 
spective at least one time offset in a bitstream, and means for mapping this respective at least one time offset to an 
entry. The apparatus may further comprise means for mapping this entry to a corresponding at least one data offset 
in a file containing a representation of a bitstream. 

25 [0233] Preferably, the apparatus comprises means for choosing the value of the at least one respective data offset 
and/or the at least one respective time offset in dependence upon a characteristic of the bitstream and/or the repre- 
sentation of the bitstream. 

[0234] Preferably, the apparatus is adapted to operate on a variable bitrate bitstream, or a representation of such a 
bitstream. 

30 [0235] Preferably the apparatus comprises means for mapping a data offset in an encoded file to a corresponding 
time offset in the bitstream. 

[0236] Preferably, the apparatus comprises means for generating at least three records, and preferably for generating 
records with periodic time offsets. 

[0237] Preferably, the apparatus comprises means for varying the period of the time offsets. 
35 [0238] Preferably, the apparatus comprises means for choosing the period to match a characteristic of the bitstream, 
and preferably to be 0.5, 1 , 2 or 1 0 seconds. 

[0239] Furthermore, the apparatus may comprise means for choosing the period of the time offsets in dependence 
on a characteristic of the stored representation of the bitstream, and preferably in dependence on the size of a cryp- 
toperiod. 

40 [0240] Preferably, the apparatus is adapted to operate on a bitstream which comprises at least one portion of bit- 
stream data which can independently be used to regenerate a respective at least one portion of audiovisual data, and 
the time offset of the at least one record corresponds to the respective at least one portion of bitstream data. 
[0241] Such portion of data may be a keyframe, for instance in an MPEG bitstream, and or may be representative, 
for example, of a background image, or overlay image. Preferably, the at least one portion of bitstream data comprises 

45 a key frame. Preferably, the bitstream comprises MPEG data, and the at least one portion of bitstream data comprises 
an intra-frame. 

[0242] Preferably, the apparatus is adapted to operate on a bitstream comprising at least one further portion of 
bitstream data which can be used to regenerate a portion of audiovisual data in conjunction with the at least one portion 
of bitstream data, and preferably the at least one further portion of bitstream data comprises a delta frame. 
so [0243] It may be that the representation of the bitstream is encoded, and preferably the apparatus is adapted to map 
at least one record to decoding data. The apparatus may comprise means for generating or obtaining such decoding 
data. 

[0244] Preferably, the apparatus comprises means for generating or obtaining a plurality of pieces of decoding data, 
each adapted to decode a respective portion of the encoded representation of the bitstream. 
55 [0245] Preferably, the apparatus comprises means for operation on, or generation, a plurality of records each map- 
ping a respective data offset in a file containing a representation of a bitstream to a corresponding time offset in the 
bitstream, and means for mapping each record to respective decoding data for decoding a respective portion of the 
encoded representation of the bitstream. 
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[0246] Furthermore, the apparatus may comprise means to operate on a representation of the bitstream comprising 
at least one piece of data mapping to decoding data and/or may comprise decoding data. The apparatus may comprise 
means for identifying and/or reading such decoding data. 

[0247] Preferably, the apparatus comprises means for referring to data within the stored representation of the bit- 
5 stream itself and/or to other data. 

[0248] Preferably, the apparatus is adapted to generate a record automatically during recordal of the representation 
of the bitstream in the file. 

[0249] Preferably, the apparatus comprises means for mapping at least one record to a respective at least one further 
record, and preferably the said at least one further record comprises conditional access information or content man- 
10 agement information. Such conditional access information or content management information may be stored or gen- 
erated by the computer program product itself. 

[0250] Decoding data may comprise, or may be included in, such further record. 

[0251] Typically, the bitstream may be divided into time segments, or cryptoperiods (encompassing a range of time 
offsets), and the apparatus may comprise means for associating a further record with a particular cryptoperiod or 
15 plurality of cryptoperiods. 

[0252] In particular, the further record may comprise a CMM or plurality of CMMs. Preferably, the apparatus may 
comprise means for generating or storing such CMM or CMMs. 

[0253] The apparatus may also comprise means for generating a further record comprising, for instance, comments, 

which could be displayed on a screen, or commands, such as television control commands. 
20 [0254] The apparatus may comprise means for storing the further record in a table of records, or in a separate file 

or table, and/or the table of records and or the related information may be stored with the file, for instance in a header. 

[0255] Preferably, the apparatus is adapted to store said at least one further record in a further table. 

[0256] Preferably, the apparatus comprises means for receiving a command of a user, and the said at least one 

further record may be inserted upon receipt of such command. 
25 [0257] Preferably, the apparatus comprises means for mapping the said at least one record to the respective at least 

one further record upon command of a user. 

[0258] Preferably, the apparatus comprises means for generating a record that maps a data offset in an encoded 
file to a corresponding time offset in the bitstream. 

[0259] Preferably, the apparatus comprises means for inserting at least one record in dependence upon a charac- 
30 teristic of the bitstream. 

[0260] Preferably, the apparatus comprises means for inserting at least one record upon command of a user. 
[0261 ] Preferably, at least one record comprises a first data point representing a respective data offset and a second 
data point representing a corresponding time offset. 

[0262] Preferably, the apparatus comprises means for inserting at least one record automatically. 
35 [0263] Preferably, the apparatus comprises means for storing at least one record in a file with the representation of 
the bitstream. 

[0264] In a related aspect of the invention, there is provided apparatus for facilitating the searching of a file containing 
a representation of a bitstream, comprising means for generating a table as described herein. 
[0265] In particular, there is provided apparatus for facilitating the searching of a file containing a representation of 
40 a bitstream, comprising means for generating a table comprising at least one record mapping a respective data offset 
in a file containing a representation of a bitstream to a corresponding time offset in the bitstream. 
[0266] Preferably, the apparatus comprises means for choosing the value of the at least one respective data offset 
and/or the at least one respective time offset in dependence upon a characteristic of the bitstream and/or the repre- 
sentation of the bitstream. 

45 [0267] In a further aspect, there is provided an apparatus for searching a file containing a representation of a bitstream 
for a desired portion of data, comprising means for jumping to a position in the file, and means for reading data from 
this position, for example until the desired portion of data is found. 

[0268] Preferably the means for reading data comprises means for reading until a desired portion of data is found, 
and/or for reading a fixed amount of data, and/or for reading an amount of data representative of a fixed period of time, 
50 and/or for reading data until a particular piece of data is read. 

[0269] Preferably the apparatus is adapted to operate on a variable bitrate bitstream, and/or a representation of such 
a bitstream. 

[0270] Preferably, apparatus comprises means for searching for a desired portion of data representative of bitstream 
data which can independently be used to regenerate a further portion of data 
55 [0271] The further portion of data may, for instance be audiovisual data, and the desired portion of data may be a 
key frame. 

[0272] Preferably, the means for jumping to a position in the file comprises means for reading a record from a table 
as herein described and means for jumping to the data offset given in the record. 



13 



EP 1 286 351 A2 



[0273] Preferably, the means for jumping to a position in the file comprises means for reading a record from a table 
as herein described and means for jumping to the data offset given in the record, and the means for reading data is 
adapted to use an at least one further record as described herein in reading data. 

[0274] The at least one further record may be conditional access information, or content management information, 
5 and may in particular be a CMM or a plurality of CMMs. The apparatus may comprise means for decoding the data in 
the file, preferably using the at least one record or further record. 

[0275] Preferably, the apparatus comprises means for choosing a data offset corresponding to the desired position 
in the file. 

[0276] Preferably, the means for reading data comprises means for decoding the data. Furthermore, the means for 
10 reading the data may be adapted to read a record from a table as described herein and decoding the data using the 
decoding data. 

[0277] In a further aspect, there is provided apparatus for searching a file containing a representation of a bitstream 
for a plurality of desired portions of data, comprising means for searching for each desired portion of data using a 
method as described herein. 

15 [0278] Preferably, the apparatus comprises means for searching for desired portions of data representative of por- 
tions of bitstream data which are periodically spaced in time. 

[0279] Preferably, the apparatus comprises for effecting a fast forwarding or rewinding operation using the desired 
portions of data. 

[0280] Preferably, the apparatus comprises means for outputting data to a display device. 
20 [0281] The desired portions of data may be located and read, typically using associated CMMs, and the resulting 
data, usually audiovisual data, may be output to a display device. 

[0282] Preferably, the apparatus comprises means for choosing the time period between the portions of bitstream 
data represented by the desired portions of data to effect a given fast-forwarding or rewinding speed. 
[0283] Preferably, the apparatus comprises means for choosing the time period between the portions of bitstream 
25 data represented by the desired portions of data in dependence upon a characteristic of the apparatus. 

[0284] Preferably, the characteristic is the maximum sustainable rate of retrieval or processing of data from the file. 
[0285] Preferably, the characteristic is a read/write hard disk access time, or a parsing demultiplexer bandwidth, or 
an operating system scheduling accuracy. 

[0286] Preferably, the given fast-forwarding or rewinding speed is varied upon command of a user. 

30 [0287] In a further aspect of the invention, there is provided an apparatus for retrieving at least one desired portion 
of data from a file containing a representation of a bitstream, comprising means for searching for the desired portion 
of data using a method as described herein, and means for retrieving the desired portion of data. 
[0288] Preferably, the apparatus is adapted to retrieve a plurality of desired portions of data from a file, and the 
searching means is adapted to search for each desired portion of data using a method as described herein, and the 

35 retrieving means is adapted to retrieve each desired portion of data in turn. 

[0289] In another aspect of the invention, there is provided apparatus for outputting data, comprising means for 
retrieving at least one desired portion of data from a file containing a representation of a bitstream using a method as 
aforesaid, and means for outputting the at least one desired portion of data. 

[0290] In a yet further aspect of the invention, there is provided apparatus for outputting data, comprising means for 
40 retrieving a plurality of desired portions of data using a method as described herein, and means for outputting each 
desired portion of data in turn. 

[0291 ] Preferably, each of the plurality of desired portions of data is representative of a respective portion of bitstream 
data, and the respective portions of bitstream data are periodically spaced in time and/or have the same duration. 
[0292] Another aspect of the invention provides apparatus for effecting a fast forwarding or rewinding operation 
45 comprising apparatus for outputting data as aforesaid. 

[0293] In yet further aspects, there is provided a processor for generation of a table as described herein, and a 
processor for analysis of characteristics of a bitstream and insertion of records in such a table in dependence upon 
this analysis. 

[0294] There is also provided a storage means for storage of a table as described herein, and preferably the storage 

50 means is adapted for storage of the file containing a representation of a bitstream. 

[0295] There is also provided a hard disk video recorder comprising a storage means as described herein and pref- 
erably further comprising a processor as described herein, and a receiver/decoder comprising such a hard disk video 
recorder. Preferably there is also provided a broadcast system incorporating such a receiver/decoder. 
[0296] In a further aspect, there is provided a receiver/decoder adapted to communicate with a hard disk video 

55 recorder as described herein, and a broadcast system incorporating such a receiver/decoder 

[0297] The invention further provides a computer program and a computer program product for carrying out any of 
the methods described herein and/or for embodying any of the apparatus features described herein, and a computer 
readable medium having stored thereon a program for carrying out any of the methods described herein and/or for 
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embodying any of the apparatus features described herein. 

[0298] The invention also provides a signal tangibly embodying a computer program and/or a computer program 
product for carrying out any of the methods described herein and/or for embodying any of the apparatus features 
described herein, a method of transmitting such a signal, and a computer product having an operating system which 
5 supports a computer program for carrying out any of the methods described herein and/or for embodying any of the 
apparatus features described herein. 

[0299] Turning to consideration of further aspects of known systems, some known systems are able record to hard 
disk received scrambled bit streams (that is, the encoded digital television signals). In one such system, the bit stream 
is retained in the compressed and scrambled form when recorded it, but the recording is then only valid for the duration 

10 of the exploitation key (which is replaced on a regular basis). One technique which overcomes this problem essentially 
consists of extracting Entitlement Control Messages (ECMs) from the bit stream before it is recorded, decrypting the 
ECMs as per usual, re-encrypting the ECMs with an internal exploitation key (unique to each subscriber), and inserting 
the ECMs back into the bit stream in their original positions (all the time not altering the control words used to scramble 
the bit stream). This has the desired effect of increasing security, but is complicated to implement, not least because 

15 it demands that the position of each ECM within the bit stream be determined precisely, which is very computationally- 
intensive. 

[0300] The present invention also seeks to remedy problems in the above and other prior art. 
[0301] Accordingly, in a further aspect of the invention, there is provided apparatus for evaluating a position in a bit 
stream, comprising means for estimating the position. 
20 [0302] Such apparatus may be included in a CMPS, and such a position may be, for instance, the start of a cryp- 
toperiod. 

[0303] By estimating the position, instead of determining it exactly, for example, the process of evaluating the position 
can be made more efficient. 

[0304] In particular, precisely determining the start of a cryptoperiod can be relatively difficult since hardware and 
25 software components can be independent to a relatively large extent. 

[0305] The position is preferably the spatial position of a data packet, such as an MPEG table, within the bit stream. 
It may alternatively be the temporal position within the bit stream, measured in seconds, for example. Preferably the 
apparatus is adapted to operate in respect of a bit stream being processed in real-time, but it may also be adapted to 
operate in respect of a static and/or random access bit stream. Furthermore, the bit stream preferably contains pack- 
so etised (such as MPEG format) and/or audio/visual data. 

[0306] The term "audio/visual" as used herein preferably connotes either audio or visual matter, or a combination of 
the two. In the context of a broadcast signal received by a receiver/decoder, the term may encompass subtitle, teletext, 
synchronisation and other data transmitted in close relation to audio and video components making up a television 
programme. 

35 [0307] The means for estimating the position is preferably adapted to estimate the position in dependence on a 
known position in the bit stream. The known position could be, for example, a transition between different portions of 
the bit stream. The dependence of the estimation on a known position in the bit stream can allow the estimate to be 
made more precisely. 

[0308] In a preferred embodiment, the apparatus further comprises means for selecting the known position from a 
40 plurality of alternatives. This can allow the estimate to be further refined, by increasing the selectivity of the process. 
[0309] Consequently, the means for selecting the known position is preferably adapted to select the known position 
in dependence on its proximity to the position to be evaluated. 

[0310] Thus, while the position to be estimated may not itself be easily or at all determinable exactly, it may be 
possible to determine known positions which are near to the position to be estimated, preferably in preference to other 

45 known positions which are not as close to the position to be evaluated. This can allow the accuracy with which the 
position is estimated to be more appropriately limited in accordance with at least one known position in the bit stream. 
[0311] The means for selecting the known position may be adapted to select systematically one of the two known 
positions closest to the position to be evaluated. This can further improve the accuracy of the estimation. In particular 
the known position may be chosen to be the closest position either before or after the estimated position. In either 

50 case, this can bias the estimate of the position either generally backwards or generally forwards in the bit stream, 
respectively. Alternatively, the known position may be chosen to be the closest position in either direction, which can 
result in no general bias of the estimate. 

[0312] Furthermore, the means for selecting the known position may be adapted to select the known position as a 
transition in the bit stream between a first and second portion of the bit stream. Such first and second portions could 
55 be, for example, segments of the bit stream transferred in direct memory access (DMA) data transfers. 

[031 3] This can make the estimation more efficient by making use of existing divisions of the bit stream when deter- 
mining the known position. One of the portions of the bit stream may contain the position to be estimated. 
[0314] Preferably the means for estimating the position may be adapted to estimate the position as an offset from 
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the known position, thereby allowing time-d is placement effects to be taken into account in the estimate. The offset 
may be zero, in which case the estimated position is equal to the known position or it may be positive or negative. 
[0315] Furthermore, the means for estimating the position may be adapted to estimate the position in dependence 
on a buffer size. Preferably the position is estimated by, amongst other things, adding the buffer size to the known 

5 position. The buffer size (preferably defined as a maximum size, or alternatively expected or exact size) may relate to 
a buffer used to transport the bit stream, such as a FIFO, for example. By estimating the position in dependence on 
the buffer size, in effect consideration can be taken of the uncertainty and/or delay arising from the use of such a buffer. 
[0316] Alternatively or additionally, the means for estimating the position may be adapted to estimate the position in 
dependence on a security parameter. In particular, the position may be estimated by, amongst otherthings, adding the 

10 security parameter to the known position. The security parameter may be negative or positive, and is preferably em- 
ployed as a 'safety factor 1 to ensure that the estimate either exceeds or remains within a critical value, and can alter- 
natively or additionally encapsulate into a single correction factor a plurality of uncertainties or biases influencing the 
estimate (such as possible timing errors, software latencies, unknown packet sizes, and so on). 
[031 7] In the preferred embodiment, the apparatus may further comprise means forstoring the bit stream. This means 

15 for storing preferably comprises a controller for causing the bit stream to be stored, but may alternatively or additionally 
comprise a corresponding storage device, such as a hard disk. This can improve the versatility of the apparatus. 
[0318] In this case, the apparatus may further comprise means for storing data associated with the bit stream sep- 
arately from the bit stream. The data associated with the bit stream preferably comprises at least one of the estimated 
position, data corresponding to the estimated position, and information which can allow the data corresponding to the 

20 estimated position to be synchronised with the stored bit stream. The means for storing data associated with the bit 
stream separately from the bit stream is preferably adapted to store conditional access data. 

[031 9] This important feature is also provided in respect of a related aspect of the invention, which provides apparatus 
for manipulating a bit stream, comprising means for receiving conditional access data, means for synchronising the 
conditional access data with the bit stream, and means for storing the bit stream. 
25 [0320] By synchronising conditional access data with the bit stream, reliance can be reduced on any conditional 
access data within the bit stream itself. 

[0321] As mentioned above, the apparatus preferably further comprises means for storing the conditional access 
data separately to the bit stream. However, the apparatus may instead comprise means for storing the conditional 
access data in the bit stream, by multiplexing or otherwise reinserting the data into the bit stream, for example. In the 
30 former case, the conditional access data may be included in a separate part of a file also containing the stored bit 
stream, or it may be stored in a separate file or in a different storage medium. 

[0322] This can improve the efficiency with which the conditional access data is managed, for example by allowing 
faster access to the generally smaller volume (with respect to the corresponding bitstream) of conditional access data. 
[0323] The means for synchronising is preferably adapted to create a reference between the conditional access data 
35 and a corresponding position in the bit stream. The apparatus more preferably further comprises means for storing the 
or each reference with or in close proximity to the conditional access data and/or bit stream. This can facilitate the task 
of synchronising the conditional access data with the bit stream. 

[0324] The apparatus may in addition comprise means for storing the reference in a table, which can further facilitate 
access to the conditional access data, for example, during reproduction of the bit stream. 
40 [0325] The means for synchronising is adapted to select the referenced position (that is, the 'corresponding position' 
in the reference between the conditional access data and a corresponding position) from a range of safe values. 
[0326] The range of safe values preferably comprises an actual position in the bit stream corresponding to the con- 
ditional access data, this being the position in the bit stream at which the conditional access data (or a copy thereof) 
is actually transmitted. 

45 [0327] If the means for synchronising is adapted to select the referenced position such that it falls within a portion 
of the bit stream to which the conditional access data corresponds, the means for synchronising is preferably further 
adapted to select the referenced position such that it falls within a cryptoperiod to which the conditional access data 
corresponds. 

[0328] This matching of the referenced position with the cryptoperiod to which the conditional access data corre- 
50 sponds can improve the quality of the synchronisation between the bit stream and conditional access data. 

[0329] Preferably the means for synchronising is adapted to select the referenced position in dependence on an 
event signifying the receipt of the conditional access data by the receiving means. This can allow the bit stream and 
conditional access data to be yet more closely synchronised. 

[0330] As previously mentioned, the apparatus may further comprise means for estimating a position in the bitstream, 
55 but also with the referenced position being selected in dependence on the estimated position. 

[0331 ] If as is preferred, the apparatus preferably further comprises means for transferring the bit stream in a plurality 
of discrete segments, the means for estimating the position is preferably adapted to estimate the position in dependence 
on an end of one of the segments, and furthermore the apparatus preferably further comprises means for predeter- 
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mining the size of at least one segment. This can improve the flexibility of the estimation process, as the variation of 
the size of the at least one segment can directly or indirectly affect the estimate itself and the stability of the estimation 
process. 

[0332] The predetermination preferably involves setting the size of the segment, although it may alternatively involve 
5 detecting the size of the segment. Possibly depending on factors such as system performance, FIFO and hard disk 

size, each segment could be as small as 1 bit and as large as 100 Mb or even greater, for example. For efficiency, 

values between approximately 1 Mb and, say, 6 Mb may be appropriate for a typical MPEG audio/visual bit stream, 

however. The means for transferring may, for example, be a direct memory access (DMA) controller, a mass storage 

device, a FIFO and/or FIFO manager, and so on. 
10 [0333] In a related aspect of the invention, there is provided apparatus for manipulating a bit stream, comprising 

means for transferring the bit stream in a plurality of discrete segments, and means for estimating a position in the bit 

stream in dependence on a property of one of the segments. 

[0334] Such a property could be segment size, for example. 

[0335] As mentioned previously, preferably the means for estimating a position is adapted to estimate the position 
15 of conditional access data, such as an ECM, in the bit stream. Also as mentioned previously, the apparatus preferably 
further comprises means for predetermining the size of a segment, which as noted can increase the flexibility of the 
estimation. 

[0336] The means for predetermining the size is ideally adapted to predetermine a size equivalent to less than a 
portion of the bit stream associated with the position. Such a portion may be a predetermined number of cryptoperiods, 

20 in which case the number of cryptoperiods need not be an integer, and indeed may be, for example, slightly less than 
a whole number to take into account the effect of FIFO buffers. This can ensure the safety of the estimation. 
[0337] The means for predetermining the size may also or alternatively be adapted to predetermine the size in de- 
pendence on a characteristic of the bit stream. By determining the size of a segment in dependence on a characteristic 
of the bit stream, account can betaken of factors related to the bit stream which may affect the accuracy of the estimate, 

25 for example. 

[0338] Furthermore, the means for predetermining the size may be adapted to predetermine the size in dependence 
on a bit rate of the bit stream. Preferably this bit rate is an average bit rate, which may be computed in respect of the 
segment in question, or any other portion of the bit stream which preferably contains the position. 
[0339] If the means for predetermining the size is adapted to predetermine a constant size, the means for predeter- 

30 mining the size may moreover comprise a static filter. If, on the other hand, the means for predetermining the size is 
adapted to predetermine a variable size, the means for predetermining the size preferably comprises a dynamic filter. 
[0340] Both types of filter preferably accept as an input at least one characteristic of the bit stream, and produce as 
an output a desired segment size. Indeed, preferably a number of filter coefficients are used, corresponding to a series 
of characteristics of the bit stream. Such characteristics could be as described above. The filter can be implemented 

35 in software, under the control of a digital signal processor (DSP), coprocessor, or main processor, for example. The 
term 'filter' as used herein preferably connotes a process or apparatus for transforming at least one input into at least 
one output; such filters could be seen as the product of a mathematical formula whose variables are the filter inputs. 
[0341] Furthermore, the means for predetermining the size may comprise at least one of a rapid dynamic filter, an 
inertial dynamic filter, and a hybrid dynamic filter. The rapid and inertial filters may be characterised in having relatively 

40 few and relatively many input values, respectively. The hybrid filter may be characterised in having properties of both 
the rapid and inertial filters, and is preferably effectively a combination of a rapid and an inertial filter, with the overall 
filter output selected as the output of a particular one of these two sub-filters in dependence on a particular constraint, 
such as whether or not a particular input is increasing or decreasing. 

[0342] The means for estimating the position may be adapted to take into account an error in at least one previous 
45 estimate. Such an error could be, for example, a time difference observed a posteriori between an estimated position 
and an actual position. This can allow the estimate to be refined over time. 

[0343] The apparatus may further comprise means for estimating the position in dependence on at least one char- 
acteristic of the bit stream. This can produce a yet more accurate estimate particularly where, for example, more 
information is available regarding the bit stream. 
50 [0344] This important feature is also provided independently. Accordingly, in a related aspect of the invention, there 
is provided apparatus for evaluating a position in a bit stream, comprising means for estimating the position in depend- 
ence on at least one characteristic of the bit stream. 

[0345] The or each characteristic is preferably at least one of a bit rate of the bit stream, the relative position within 
the bit stream, and the time elapsed between parts of the bit stream. 
55 [0346] The apparatus may further comprise means for estimating a measure of separation between the occurrence 
of the position and the occurrence of an event relating to the position. Such a measure of separation could be the time 
At discussed below, for example. This can provide more information with which to make a better estimate. 
[0347] The means for estimating the position in the bit stream is preferably adapted to incorporate the measure of 
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separation, preferably in conjunction with an estimate of the bit rate of the bit stream close to the position in the bit 
stream. This can further refine the estimation process. 

[0348] The means for estimating a measure of separation is preferably adapted to measure the separation between 
the occurrence of the position and the end of a processing operation. The processing operation is preferably related 
5 to the processing of data associated with the position in the bit stream. 

[0349] In a further related aspect of the invention, there is provided a receiver/decoder incorporating apparatus (in 
any of the various aspects) as aforesaid. 

[0350] There is also provided, in a yet further aspect, a method of evaluating a position in a bit stream, comprising 
estimating the position. 

10 [0351] In another aspect of the invention, there is provided a method of manipulating a bit stream, comprising re- 
ceiving conditional access data, synchronising the conditional access data with the bit stream, and storing the bit 
stream. 

[0352] In a further aspect of the invention, there is provided a method of manipulating a bit stream, comprising trans- 
ferring the bit stream in a plurality of discrete segments, and estimating a position in the bit stream in dependence on 

15 a property of one of the segments. 

[0353] In a yet further aspect of the invention, there is provided a method of evaluating a position in a bit stream, 
comprising estimating the position in dependence on at least one characteristic of the bit stream. 
[0354] In a further aspect of the invention, there is provided a computer program product for evaluating a position in 
a bit stream, comprising means for estimating the position. 

20 [0355] The position is preferably the spatial position of a data packet, such as an MPEG table, within the bit stream. 
It may alternatively be the temporal position within the bit stream, measured in seconds, for example. Preferably the 
computer program product is adapted for use in respect of a bit stream being processed in real-time, but it may also 
be used in respect of a static and/or random access bit stream. Furthermore, the bit stream preferably contains pack- 
etised (such as MPEG format) and/or audio/visual data. 

25 [0356] Preferably, the means for estimating the position comprises means for estimating the position in dependence 
on a known position in the bit stream. 

[0357] Preferably, the computer program product further comprises means for selecting the known position from a 
plurality of alternatives. 

[0358] Preferably, the means for selecting the known position is comprises means for selecting the known position 

30 in dependence on its proximity to the position to be evaluated. 

[0359] Thus, while the position to be estimated may not itself be easily or at all determinable exactly, it may be 
possible to determine known positions which are near to the position to be estimated, preferably in preference to other 
known positions which are not as close to the position to be evaluated. This can allow the accuracy with which the 
position is estimated to be more appropriately limited in accordance with at least one known position in the bit stream. 

35 [0360] Preferably the means for selecting the known position comprises means for selecting systematically one of 
the two known positions closest to the position to be evaluated. In particular, the known position may be chosen to be 
the closest position either before or after the estimated position. In either case, this can bias the estimate of the position 
either generally backwards or generally forwards in the bit stream, respectively. Alternatively, the known position may 
be chosen to be the closest position in either direction, which can result in no general bias of the estimate. 

40 [0361 ] Furthermore, the means for selecting the known position may comprise means for selecting the known position 
as a transition in the bit stream between a first and second portion of the bit stream. 

[0362] This can make the estimation more efficient by making use of existing divisions of the bit stream when deter- 
mining the known position. One of the portions of the bit stream may contain the position to be estimated. 
[0363] Preferably the mean for estimating the position may comprise means for estimating the position as an offset 
45 from the known position , thereby allowing time-displacement effects to be taken into account in the estimate. The offset 
may be zero, in which case the estimated position is equal to the known position or it may be positive or negative. 
[0364] Furthermore, the means for estimating the position may comprise means for estimating the position in de- 
pendence on a buffer size. 

[0365] Alternatively or additionally the means for estimating the position may comprise means for estimating the 

50 position in dependence on a security parameter. 

[0366] Preferably, the computer program product comprises means for storing the bit stream. 
[0367] Preferably computer program product includes means for storing data associated with the bit stream sepa- 
rately from the bit stream. The data associated with the bit stream preferably comprises at least one of the estimated 
position, data corresponding to the estimated position, and information which can allow the data corresponding to the 

55 estimated position to be synchronised with the stored bit stream. Preferably the computer program product further 
comprises means for storing conditional access data. 

[0368] This important feature is also provided in respect of a related aspect of the invention, which provides a com- 
puter program product for manipulating a bit stream, comprising means for receiving conditional access data, means 
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for synchronising the conditional access data with the bit stream, and means for storing the bit stream. 
[0369] Preferably the computer program product includes means for storing conditional access data separately to 
the bit stream. Alternatively, the computer program product may comprise means for storing the conditional access 
data in the bit stream, by multiplexing or otherwise reinserting the data into the bit stream, for example. In the former 
5 case, the conditional access data may be included in a separate part of a file also containing the stored bit stream, or 
it may be stored in a separate file or in a different storage medium. 

[0370] The means for synchronising preferably comprises means for creating a reference between the conditional 
access data and a corresponding position in the bit stream. The computer program product more preferably further 
comprises means for storing the or each reference with or in close proximity to the conditional access data and/or bit 
10 stream. 

[0371 ] Preferably, the computer program product further comprises means for storing the reference in a table, which 
can further facilitate access to the conditional access data, for example, during reproduction of the bit stream. 
[0372] The means for synchronising preferably comprises means for selecting the referenced position (that is, the 
'corresponding position' in the reference between the conditional access data and a corresponding position) from a 
15 range of safe values. 

[0373] The range of safe values preferably comprises an actual position in the bit stream corresponding to the con- 
ditional access data, this being the position in the bit stream at which the conditional access data (or a copy thereof) 
is actually transmitted. 

[0374] If the means for synchronising comprises means for selecting the referenced position such that it falls within 
20 a portion of the bit stream to which the conditional access data corresponds, the means for synchronising preferably 
further comprises means for selecting the referenced position such that it falls within a cryptoperiod to which the con- 
ditional access data corresponds. 

[0375] Preferably means for synchronising comprises means for selecting the referenced position in dependence 
on an event signifying the receipt of the conditional access data by the receiving means. 
25 [0376] Preferably, the computer program product further comprises means for estimating a position in the bit stream, 
and means for selecting the referenced position in dependence on the estimated position. 

[0377] If as is preferred, the computer program product preferably further comprises means for transferring the bit 
stream in a plurality of discrete segments, the means for estimating the position preferably comprises means for esti- 
mating the position in dependence on an end of one of the segments, and furthermore the computer program product 

30 preferably further comprises means for predetermining the size of at least one segment. 

[0378] In a related aspect of the invention, there is provided a computer program product for manipulating a bit 
stream, comprising means for transferring the bit stream in a plurality of discrete segments, and means for estimating 
a position in the bit stream in dependence on a property of one of the segments. 
[0379] Such a property could be segment size, for example. 

35 [0380] As mentioned previously, preferably the means for estimating a position comprises estimating the position of 
conditional access data, such as an ECM, in the bit stream. Also as mentioned previously, the computer program 
product preferably further comprises means for predetermining the size of a segment, which as noted can increase 
the flexibility of the estimation. 

[0381] The means for predetermining the size ideally comprises means for predetermining a size equivalent to less 
40 than a portion of the bit stream associated with the position. 

[0382] The means for predetermining the size may also or alternatively comprise means for predetermining the size 
in dependence on a characteristic of the bit stream. 

[0383] Furthermore, the means for predetermining the size may comprise means for predetermining the size in de- 
pendence on a bit rate of the bit stream. Preferably this bit rate is an average bit rate, which may be computed in 

45 respect of the segment in question, or any other portion of the bit stream which preferably contains the position. 

[0384] If the means for predetermining the size comprises means for predetermining a constant size, the means for 
predetermining the size may moreover comprise means for statically filtering. If, on the other hand, the means for 
predetermining the size comprises means for predetermining a variable size, the means for predetermining the size 
preferably comprises means for dynamic filtering. 

so [0385] Furthermore, the means for predetermining the size may comprise at least one of means for rapid dynamic 
filtering, means for inertial dynamic filtering, and means for hybrid dynamic filtering. The means for rapid and inertial 
filtering may be characterised in having relatively few and relatively many input values, respectively. The means for 
hybrid filtering may be characterised in having properties of both the rapid and inertial filtering, and is preferably effec- 
tively a combination of a means for rapid and a means for inertial filtering, with the overall filtering output selected as 

55 the output of a particular one of these two sub-filterings in dependence on a particular constraint, such as whether or 
not a particular input is increasing or decreasing. 

[0386] The means for estimating the position may comprise means for taking into account an error in at least one 
previous estimate. 
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[0387] The computer program product may further comprise means for estimating the position in dependence on at 
least one characteristic of the bit stream. 

[0388] This important feature is also provided independently. Accordingly, in a related aspect of the invention, there 
is provided a computer program product for evaluating a position in a bit stream, comprising means for estimating the 
5 position in dependence on at least one characteristic of the bit stream. 

[0389] The or each characteristic is preferably at least one of a bit rate of the bit stream, the relative position within 
the bit stream, and the time elapsed between parts of the bit stream. 

[0390] The computer program product may further comprise means for estimating a measure of separation between 
the occurrence of the position and the occurrence of an event relating to the position. Such a measure of separation 
10 could be the time At discussed below, for example. 

[0391] The means for estimating the position in the bit stream preferably comprises means for incorporating the 
measure of separation, preferably in conjunction with an estimate of the bit rate of the bit stream close to the position 
in the bit stream. 

[0392] The means for estimating a measure of separation preferably comprises means for measuring the separation 
15 between the occurrence of the position and the end of a processing operation. The processing operation is preferably 
related to the processing of data associated with the position in the bit stream. 

[0393] In a further aspect of the invention, there is provided a method for evaluating a position in a bit stream, com- 
prising estimating the position. 

[0394] The position is preferably the spatial position of a data packet, such as an MPEG table, within the bit stream. 
20 it may alternatively be the temporal position within the bit stream, measured in seconds, for example. Preferably the 
method is carried out in respect of a bit stream being processed in real-time, but it may also be carried out in respect 
of astatic and/or random access bit stream. Furthermore, the bit stream preferably contains packetised (such as MPEG 
format) and/or audio/visual data. 

[0395] Preferably, the step of estimating the position comprises estimating the position in dependence on a known 
25 position in the bit stream. 

[0396] Preferably, the method further comprises the step of selecting the known position from a plurality of alterna- 
tives. 

[0397] Preferably, the step of selecting the known position is comprises selecting the known position in dependence 
on its proximity to the position to be evaluated. 

30 [0398] Thus, while the position to be estimated may not itself be easily or at all determinable exactly, it may be 
possible to determine known positions which are near to the position to be estimated, preferably in preference to other 
known positions which are not as close to the position to be evaluated. This can allow the accuracy with which the 
position is estimated to be more appropriately limited in accordance with at least one known position in the bit stream. 
[0399] Preferably the step of selecting the known position comprises selecting systematically one of the two known 

35 positions closest to the position to be evaluated. In particular, the known position may be chosen to be the closest 
position either before or after the estimated position. In either case, this can bias the estimate of the position either 
generally backwards or generally forwards in the bit stream, respectively. Alternatively, the known position may be 
chosen to be the closest position in either direction, which can result in no general bias of the estimate. 
[0400] Furthermore, the step of selecting the known position may comprise selecting the known position as a tran- 

40 sition in the bit stream between a first and second portion of the bit stream. 

[0401 ] This can make the estimation more efficient by making use of existing divisions of the bit stream when deter- 
mining the known position. One of the portions of the bit stream may contain the position to be estimated. 
[0402] Preferably the step of estimating the position may comprise estimating the position as an offset from the 
known position, thereby allowing time-displacement effects to be taken into account in the estimate. The offset may 

45 be zero, in which case the estimated position is equal to the known position or it may be positive or negative. 

[0403] Furthermore, the step of estimating the position may comprise estimating the position in dependence on a 
buffer size. 

[0404] Alternatively or additionally, the step of estimating the position may comprise estimating the position in de- 
pendence on a security parameter. 

50 [0405] Preferably, the method comprises the step of storing the bit stream. 

[0406] Preferably data associated with the bit stream is stored separately from the bit stream. The data associated 
with the bit stream preferably comprises at least one of the estimated position, data corresponding to the estimated 
position, and information which can allow the data corresponding to the estimated position to be synchronised with the 
stored bit stream. Preferably the method further comprises storing conditional access data. 

55 [0407] This important feature is also provided in respect of a related aspect of the invention, which provides a method 
for manipulating a bit stream, comprising receiving conditional access data, synchronising the conditional access data 
with the bit stream, and storing the bit stream. 

[0408] Preferably conditional access data is stored separately to the bit stream. Alternatively, the method may com- 
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prise storing the conditional access data in the bit stream, by multiplexing or otherwise reinserting the data into the bit 
stream, for example. In the former case, the conditional access data may be included in a separate part of a file also 
containing the stored bit stream, or it may be stored in a separate file or in a different storage medium. 
[0409] The step of synchronising preferably comprises creating a reference between the conditional access data 
5 and a corresponding position in the bit stream. The method more preferably further comprises storing the or each 
reference with or in close proximity to the conditional access data and/or bit stream. 

[0410] Preferably, the method further comprises storing the reference in a table, which can further facilitate access 
to the conditional access data, for example, during reproduction of the bit stream. 

[0411] The step of synchronising preferably comprises selecting the referenced position (that is, the 'corresponding 
10 position' in the reference between the conditional access data and a corresponding position) from a range of safe values. 
[0412] The range of safe values preferably comprises an actual position in the bit stream corresponding to the con- 
ditional access data, this being the position in the bit stream at which the conditional access data (or a copy thereof) 
is actually transmitted. 

[0413] If the step of synchronising comprises selecting the referenced position such that it falls within a portion of 
15 the bit stream to which the conditional access data corresponds, the step of synchronising preferably further comprises 
selecting the referenced position such that it falls within a cryptoperiod to which the conditional access data corre- 
sponds. 

[0414] Preferably the step of synchronising comprises selecting the referenced position in dependence on an event 
signifying the receipt of the conditional access data by the receiving means. 
20 [0415] Preferably, the method further comprises the step of estimating a position in the bit stream, and of selecting 
the referenced position in dependence on the estimated position. 

[0416] If as is preferred, the method preferably further comprises transferring the bit stream in a plurality of discrete 
segments, the step of estimating the position preferably comprises estimating the position in dependence on an end 
of one of the segments, and furthermore the method preferably further comprises predetermining the size of at least 
25 one segment. 

[0417] In a related aspect of the invention, there is provided a method of manipulating a bit stream, comprising 
transferring the bit stream in a plurality of discrete segments, and estimating a position in the bit stream in dependence 
on a property of one of the segments. 

[0418] Such a property could be segment size, for example. 
30 [0419] As mentioned previously, preferably the step of estimating a position comprises estimating the position of 

conditional access data, such as an ECM, in the bit stream. Also as mentioned previously, the method preferably further 

comprises predetermining the size of a segment, which as noted can increase the flexibility of the estimation. 

[0420] The step of predetermining the size ideally comprises predetermining a size equivalent to less than a portion 

of the bit stream associated with the position. 
35 [0421 ] The step of predetermining the size may also or alternatively comprise predetermining the size in dependence 

on a characteristic of the bit stream. 

[0422] Furthermore, the step of predetermining the size may comprise predetermining the size in dependence on a 
bit rate of the bit stream. Preferably this bit rate is an average bit rate, which may be computed in respect of the segment 
in question, or any other portion of the bit stream which preferably contains the position. 

40 [0423] If the step of predetermining the size comprises predetermining a constant size, the step of predetermining 
the size may moreover comprise statically filtering. If, on the other hand, the step of predetermining the size comprises 
predetermining a variable size, the step of predetermining the size preferably comprises dynamic filtering. 
[0424] Furthermore, the step of predetermining the size may comprise at least one of rapid dynamic filtering, inertial 
dynamic filtering, and hybrid dynamic filtering. The rapid and inertial filtering may be characterised in having relatively 

45 few and relatively many input values, respectively. The hybrid filtering may be characterised in having properties of 
both the rapid and inertial filtering, and is preferably effectively a combination of a rapid and an inertial filtering, with 
the overall filtering output selected as the output of a particular one of these two sub-filterings in dependence on a 
particular constraint, such as whether or not a particular input is increasing or decreasing. 

[0425] The step of estimating the position may comprise taking into account an error in at least one previous estimate. 
50 [0426] The method may further comprise estimating the position in dependence on at least one characteristic of the 
bit stream. 

[0427] This important feature is also provided independently. Accordingly, in a related aspect of the invention, there 
is provided a method for evaluating a position in a bit stream, comprising estimating the position in dependence on at 
least one characteristic of the bit stream. 
55 [0428] The or each characteristic is preferably at least one of a bit rate of the bit stream, the relative position within 
the bit stream, and the time elapsed between parts of the bit stream. 

[0429] The method may further comprise estimating a measure of separation between the occurrence of the position 
and the occurrence of an event relating to the position. Such a measure of separation could be the time At discussed 
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below, for example. 

[0430] The step of estimating the position in the bit stream preferably comprises incorporating the measure of sep- 
aration, preferably in conjunction with an estimate of the bit rate of the bit stream close to the position in the bit stream. 
[0431] The step of estimating a measure of separation preferably comprises measuring the separation between the 
5 occurrence of the position and the end of a processing operation. The processing operation is preferably related to the 
processing of data associated with the position in the bit stream. 

[0432] In another aspect of the invention, there is provided a broadcast system comprising a broadcast centre and 
a receiver/decoder as aforesaid. 

[0433] In a further aspect of the invention, there is provided a computer program product adapted to carry out a 
10 method as aforesaid. 

[0434] In a yet further aspect of the invention, there is provided a computer readable medium having stored thereon 
a computer program product as aforesaid. 

[0435] In another aspect of the invention, there is provided a signal tangibly embodying a computer program product 
as aforesaid. 

15 [0436] The invention also provides a computer program and a computer program product for carrying out any of the 
methods described herein and/or for embodying any of the apparatus features described herein, and a computer read- 
able medium having stored thereon a program for carrying out any of the methods described herein and/orfor embod- 
ying any of the apparatus features described herein. 

[0437] The invention also provides a signal embodying a computer program for carrying out any of the methods 

20 described herein and/or for embodying any of the apparatus features described herein, a method of transmitting such 
a signal, and a computer product having an operating system which supports a computer program for carrying out any 
of the methods described herein and/or for embodying any of the apparatus features described herein. 
[0438] Turning to consideration of further prior art, video cassette recorders and also audio cassette recorders have 
become ubiquitous, having application in both domestic and professional environments. However, their principal short- 

25 coming is that data signals are recorded on a tape, and can therefore only be accessed serially. The tape must be fast- 
wound if a section of it is to be skipped, or to access a particular part of a recording. This is a relatively slow procedure. 
Moreover, many tape recorders, particularly of the low-cost type most commonly found in domestic applications, are 
incapable of reproducing a recording at a speed other than that at which it was recorded (for a slow-motion or accel- 
erated motion effect) or a single frozen frame of a recording without significant distortion of the display. 

30 [0439] High-capacity mass data storage devices, and in particular, hard disc drives, now have a storage capacity 
large enough to enable them to store a significant amount of digitally-encoded video and/or audio signals, particularly 
when such signals are encoded using an efficient compression algorithm such as MPEG. Any given piece of data 
stored on the device can be accessed, at least from the point of view of a human operator, essentially instantaneously. 
The availability of such devices has led to development of apparatus for recording and reproducing video and/or audio 

35 signals in which the signals are stored on such a mass-storage device. 

[0440] Implementation of video and/or audio playback apparatus using such mass storage has the potential to offer 
a user far greater operational flexibility than a conventional tape-based video and/or audio recorder, and gives devel- 
opers the opportunity to provide video and/or audio playback products that have a range of capabilities beyond those 
of a conventional tape recorder. It is a further aim of this invention to provide means by which a developer can make 

40 use these features offered by such playback apparatus. 

[0441] Accordingly, in a further aspect of the invention, there is provided a command for controlling the transfer of 
an audio/visual bit stream, wherein the transfer speed is represented as a parameter. 

[0442] The transfer is preferably the reproduction of audio/visual data, from a mass storage device to an audiovisual 
playback device (such as an MPEG decoder and/or video output device), for example. Alternatively (and not exclu- 
45 sively), the transfer may be the recording of audio/visual data, from a live broadcast (or other) signal source to a mass 
storage device, for example. 

[0443] By being able to set the transfer speed via a parameter of the command, a number of different effects can be 
achieved with a call to the same command. Such a command could, for example, be used to control the operations of 
a virtual (or real) video recorder or other random access or sequential access storage device. The set_speed() com- 

50 mand described later is an example of such a command, applied principally to the reproduction of audio/visual data. 
[0444] The term "command" as used herein preferably connotes a physical manifestation of a software routine pro- 
grammed to carry out a specified function, preferably in the form of electrical impulses in a memory or in a more 
permanent form, such as a recording of the routine on a suitable data carrier, for example. Preferably the manifestation 
of the routine is immediately executable by a processor, being stored as object code, for example. The term may also 

55 be extended to cover the actual invocation of such a routine, either in the form of a physically-embodied instruction to 
execute the routine, or as an actual signal - such as a remote procedure call (RPC) - designed to cause the routine to 
execute. 

[0445] The speed may be positive, zero and/or negative. In the case where the transfer is a reproduction, if the speed 
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is positive, the reproduction would preferably be one of normal playback, slow playback, fast forwarding, and stop/ 
pause. Alternatively, if the speed is negative, the reproduction would preferably be one of fast rewind and slow rewind. 
Thus, by allowing such a range of speeds, the flexibility offered by the command can be increased. 
[0446] If the range of speeds is limited by hardware or other considerations, the maximum speed is preferably the 

5 equivalent of 2, 5, 10, 50, 1 00 or 500 times a normal transfer speed. Correspondingly, the minimum speed may be the 
equivalent of 1 , 0, -1 , -2, -5, -1 0, -50, -1 00 or -500 times the normal transfer speed (a minimum of 0 or more preventing 
the possibility of 'rewinding' the stream, in the reproduction case, and a minimum of 0 or less opening the possibility 
of storing an audio/visual bit stream in reverse, in the recording case). The range of speeds may be a continuous range, 
allowing smooth transitions between different transfer speeds, for example, or a discrete set of speeds, for example, 

10 possibly taking into account hardware limitations. The parameter of the command may, in fact, be an arbitrary speed 
which is converted into one of the discrete set of speeds, as appropriate, during the execution of the command or 
subsequently. 

[0447] The speed is preferably related to the parameter by a multiple of a normal transfer speed (such as the normal 
playback speed in the reproduction case). This can greatly simplify procedures invoking the command, since they 

15 might not need to calculate corresponding bit rates for reproduction of the bit stream, for example. In the recording 
case, the parameter may, for example, specify the desired frame rate (such that if it was lower than the normal frame 
rate, the command would cause frames to be discarded from the stored bit stream at an appropriate rate). 
[0448] If the speed was equal to the parameter multiplied by a normal transfer speed, for example, a parameter of 
1 would be equivalent to a normal transfer speed, a parameter of 0 would result in the transfer being paused, and a 

20 parameter greater than 1 would correspond to fast forwarding (in the reproduction case) or recording at a lower quality/ 
speed (in the recording case), for example. Alternatively, there may be a more complex relationship between speed 
and parameter, whereby a constant value is subtracted from either the speed or parameter, for example. 
[0449] Preferably a position from which the transfer is to take place is represented as a parameter. This can allow 
further flexibility in the transfer of an audio/visual bit stream. In the case where the transfer is the reproduction of audio/ 

25 visual data, the position from which the transfer is to take place is preferably an offset into the audio/visual data, and 
may be set to the nearest bit, byte, given other data multiple, given period of time, or frame of data, or may otherwise 
or additionally be specified in terms of programme or track numbers. Otherwise, in the recording case, for example, 
the position can be relative to a position on a mass storage device, setting the position at which recording is to start 
or continue. 

30 [0450] This important feature is also provided independently. Accordingly in a further aspect of the invention there 
is provided a command for controlling the transfer of an audio/visual bit stream, wherein the position from which the 
transfer is to take place is represented as a parameter. The set_pos() routine described later is an example of such a 
function. 

[0451] The parameter specifying the position from which reproduction is to take place may be related to a measure 
35 of time, which can free the invoking routine from calculations relating the time to the data offset in the bit stream. 

[0452] If, instead, the parameter specifying the position from which reproduction is to take place is related to an offset 
in the bit stream (or location on a mass storage device, for example), the command can be more simply implemented, 
resulting in a saving of memory and increasing the speed of execution. 

[0453] In another aspect of the invention, the is provided a command set, comprising at least one command as 
40 aforesaid. This can allow a wide range of more specialised commands to be implemented easily, by using any of the 
above-mentioned commands as building blocks. 

[0454] This important feature is also provided independently, and accordingly there is also provided a command set 
for controlling the transfer of an audio/visual bit stream, comprising a command having the position from which repro- 
duction is to take place represented as a parameter, and a command having the transfer speed represented as a 
45 parameter. 

[0455] In a further related aspect of the invention, there is provided a command for controlling the transfer of an 
audio/visual bit stream, the command adapted to invoke at least one command as aforesaid. 

[0456] The command may be adapted to selectively invoke different further commands in dependence on a state 
relating to the transfer of the audio/visual bit stream. Such a state could be, for example, whether the transfer was 
50 paused or not (in other words, whether or not the transfer speed was zero); in this case, the command could, for 
example, call one further command when the transfer is paused, and a different further command when the transfer 
is in progress. 

[0457] This can allow the further commands to be simplified, since they could be written without having to take into 
consideration certain values of the abovementioned state. 
55 [0458] Alternatively or additionally, the command may be adapted to invoke a command (preferably for setting the 
transferspeed) as aforesaid, with a parameter equivalentto a normal transfer speed, and invoke a command (preferably 
for setting the position of reproduction) as aforesaid, with a parameter equivalent to a position in the audio/visual bit 
stream. Preferably such a command is adapted to start playback in the audio/visual bit stream, and may itself corre- 
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spond to or be invoked by a 'play' or a 'seek and play' command. Also, such a command preferably has at least one 
parameter in the same format as at least one parameter of one or both of the invoked commands. 
[0459] The command may be adapted to invoke a command (preferably for setting the transfer speed) as aforesaid, 
with a parameter equivalent to zero speed. This command is preferably adapted to stop or pause playback of an audio/ 
5 visual bit stream, and may itself correspond to or be invoked by a 'pause' or a 'stop' command. The invoked command 
may also cause the display of the audio/visual bit stream to be ceased. 

[0460] The command may alternatively be adapted to invoke a command (preferably for setting the transfer speed) 
as aforesaid, with a parameter equivalent to a greater than normal playback speed. Preferably the command is adapted 
to fast-forward an audio/visual bit stream, and may itself correspond to or be invoked by a 'fast-forward' command. 
10 Furthermore, the command may be adapted to further invoke the command with a different parameter, for example to 
cause the bit stream to be reproduced faster the longer a 'fast-forward' button is depressed. 

[0461 ] The command may be adapted to invoke a command (preferably for setting the transfer speed) as aforesaid, 
with a parameter equivalent to a less than normal transfer speed. This command may be adapted to play in slow motion 
an audio/visual bit stream, and may itself correspond to or be invoked by a 'slow motion' command. 

15 [0462] The command may instead or additionally be adapted to invoke a command (preferably for setting the transfer 
speed) as aforesaid, with a parameter equivalent to a negative playback speed. Preferably this command is adapted 
to play in reverse an audio/visual bit stream, and may itself correspond to or be invoked by a 'rewind' command. 
[0463] Furthermore, the command may be adapted to invoke a command (preferably for setting the transfer speed) 
as aforesaid, with a parameter equivalent to a normal playback speed. Preferably this command is adapted to resume 

20 playback of an audio/visual bit stream, and may itself correspond to or be invoked by a 'play', 'pause' or 'un-pause' 
command. 

[0464] The command may be adapted to invoke a command (preferably for setting the position of reproduction) as 
aforesaid, with a parameter equivalent to the location. Preferably this command is adapted to jump to a location in the 
audio/visual bit stream, and may itself correspond to or be invoked by a 'next chapter up', 'previous chapter', 'play', 
25 'next index', or 'previous index' command. 

[0465] The command may be adapted to cause the or a further audio/visual bit stream to be stored. Thus flexibility 
can be achieved by combining commands to reproduce a bit stream with the ability to store (preferably to record) the 
or a further bit stream. 

[0466] In a related aspect of the invention, there is provided a command for controlling the transfer of an audio/visual 
30 bit stream, the command adapted to invoke at least one command as aforesaid (including, particularly, the commands 
which invoke further commands). 

[0467] Despite providing up to three levels of abstraction or more, this has been found pursuant to the present in- 
vention to provide the advantage of further computational simplicity. 

[0468] In particular, if the command corresponds to a user-selectable audio/visual control operation, each layer of 
35 commands can itself be relatively simple, and have a relatively simple interface with the layers above and below, and 
yet cause sophisticated low-level actions to occur in response to a single high-level user (or other) request. 
[0469] In a further aspect of the invention, there is provided a method of controlling the transfer of an audio/visual 
bitstream, comprising comparing a command as described herein to a control criterion, and generating a further com- 
mand in dependence upon whether the command matches the control criterion, and preferably generating a further 
40 command if the command does not match the control criterion. 

[0470] Preferably the command is a further command generated as aforesaid. 

[0471] Thus, invalid or undesired commands or sequences of commands may be amended, or default commands 
may be substituted in their place. 

[0472] Preferably, the further command is compared to the control criterion, and the further command is then amend- 
45 ed in dependence upon whether it matches the control criterion. 

[0473] The comparison between the further command and the control criterion, and amendment of the further com- 
mand may be repeated, either up to a maximum number of repetitions or indefinitely, until a further command is gen- 
erated which matches the control criteria. 

[0474] Preferably, the control criterion is dependent upon a characteristic of the transfer of the audio/visual bitstream, 
50 preferably of the transfer occurring at the time of receipt of the command. 

[0475] Thus, greater control over the transfer of an audio/visual bitstream may be obtained upon receipt of sequences 
of commands, or upon receipt of commands which specify operations which are relative to a current characteristic of 
the transfer of the audio/visual bitstream. 

[0476] For instance certain sequences of commands, or operations on a bitstream, which are not allowed or which 
55 are undesirable may be detected and replaced. 

[0477] For instance it may not be allowed to jump to a point in the bitstream and then fast forward, and a command 
to fast forward may be replaced by a command to play if it is received immediately after a command to jump to a point 
in the bitstream. 
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[0478] Other commands may be relative to a current characteristic of the transfer of the audio/visual bitstream. For 
instance, a command may specify jumping forward to a position relative to the current position. The acceptability of 
this command may be dependent both upon the command itself and the current position. 

[0479] Preferably, the characteristic of the transfer of the audio/visual bitstream is a transfer speed and or a position 
5 in the bitstream. 

[0480] Preferably, the control criterion is dependent upon conditional access and or parental control data. 
[0481] In a further aspect of the invention there is provided a method of controlling the transfer of an audio/visual bit 
stream, comprising invoking a command to set the transfer speed, and passing the transfer speed as a parameter to 
the command. 

10 [0482] In another aspect of the invention there is provided a method of controlling the transfer of an audio/visual bit 
stream, comprising invoking a command to set a position from which reproduction is to take place, and passing the 
position as a parameter. 

[0483] The command may be a function call, for example a 'SetSpeed' command. The bitstream may be, for example, 
a recorded television programme. The parameter may be, for instance, an integer passed in a function call. 
15 [0484] The majority of operations which may be required of a hard disk recorder can all be performed with the com- 
mand or commands, and greater flexibility and efficiency can be afforded on account of the relatively compact command 
set. 

[0485] The features of an automaton can be provided, allowing an easily expandable and reliable way to add extra 
features- such as a security lock for example. In the case of such a security lock, a SetPosition command having a 
20 parameter equivalent to a disallowed track might recursively call the SetPosition command with a parameter equivalent 
to the track following the current one, until an allowable track was found. 

[0486] In a further aspect of the invention, there is provided a method of controlling the transfer of an audio/visual 
bit stream, comprising representing the transfer speed as a parameter. 

[0487] The speed may be positive, zero and/or negative. In the case where the transfer is a reproduction, if the speed 
25 is positive, the reproduction would preferably be one of normal playback, slow playback, fast forwarding, and stop/ 
pause. Alternatively, if the speed is negative, the reproduction would preferably be one of fast rewind and slow rewind. 
Thus, by allowing such a range of speeds, the flexibility offered by the method can be increased. 
[0488] If the range of speeds is limited by hardware or other considerations, the maximum speed is preferably the 
equivalent of 2, 5, 10, 50, 1 00 or 500 times a normal transfer speed. Correspondingly, the minimum speed may be the 
30 equivalent of 1 , 0. -1 , -2, -5, -1 0, -50, -1 00 or -500 times the normal transfer speed (a minimum of 0 or more preventing 
the possibility of 'rewinding' the stream, in the reproduction case, and a minimum of 0 or less opening the possibility 
of storing an audio/visual bit stream in reverse, in the recording case). The range of speeds may be a continuous range, 
allowing smooth transitions between different transfer speeds, for example, or a discrete set of speeds, for example, 
possibly taking into account hardware limitations. The parameter may, in fact, be an arbitrary speed which is converted 
35 into one of the discrete set of speeds, as appropriate, during the execution of the command or subsequently. 

[0489] The method preferably further comprises relating the speed to the parameter by a mu Itiple of a normal transfer 
speed (such as the normal playback speed in the reproduction case). 

[0490] Alternatively, there may be a more complex relationship between speed and parameter, whereby the method 
comprises subtracting a constant value from either the speed or parameter, for example. 

40 [0491] Preferably the method comprises representing a position from which the transfer is to take place as a param- 
eter. This can allow further flexibility in the transfer of an audio/visual bit stream. In the case where the transfer is the 
reproduction of audio/visual data, the position from which the transfer is to take place is preferably an offset into the 
audio/visual data, and may be set to the nearest bit, byte, given other data multiple, given period of time, or frame of 
data, or may otherwise or additionally be specified in terms of programme or track numbers. Otherwise, in the recording 

45 case, for example, the position can be relative to a position on a mass storage device, setting the position at which 
recording is to start or continue. 

[0492] This important feature is also provided independently. Accordingly in a further aspect of the invention there 
is provided a method of controlling the transfer of an audio/visual bit stream, comprising representing the position from 
which the transfer is to take place as a parameter. The set_pos() routine described later is an example of such a function. 

50 [0493] The parameter specifying the position from which reproduction is to take place may be related to a measure 
of time, which can free the invoking routine from calculations relating the time to the data offset in the bit stream. 
[0494] If, instead, the parameter specifying the position from which reproduction is to take place is related to an offset 
in the bit stream (or location on a mass storage device, for example), the method can be more simply implemented, 
resulting in a saving of memory and increasing the speed of execution. 

55 [0495] In another aspect of the invention, there is provided a method for controlling the transfer of an audio visual 
bitstream comprising a combination of methods, or method steps, as aforesaid. This can allow a wide range of more 
specialised procedures to be carried out easily, by using any of the above-mentioned methods or method steps as 
building blocks. 
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[0496] This important feature is also provided independently, and accordingly there is also provided a method for 
controlling the transfer of an audio/visual bit stream, comprising representing the position from which reproduction is 
to take place as a parameter, and representing the transfer speed as a parameter. 

[0497] In a further related aspect of the invention, there is provided a method of controlling the transfer of an audio/ 

5 visual bit stream, comprising invoking at least one command as described herein. 

[0498] The method may comprise selectively invoking a command as described herein in dependence on a state 
relating to the transfer of the audio/visual bit stream. Such a state could be, for example, whether the transfer was 
paused or not (in other words, whether or not the transfer speed was zero); in this case, the method could, for example, 
comprise calling one further command when the transfer is paused, and a different further command or method step 

10 when the transfer is in progress. 

[0499] This can allow the further commands to be simplified, since they could be written without having to take into 
consideration certain values of the abovementioned state. 

[0500] Alternatively or additionally, the method may comprise invoking a command (preferably for setting the transfer 
speed) as described herein, with a parameter equivalent to a normal transfer speed, and invoking a command, (pref- 
15 erably for setting the position of reproduction) as described herein, with a parameter equivalent to a position in the 
audio/visual bit stream. Preferably such a method is a method for starting playback in the audio/visual bit stream, and 
may itself correspond to or be invoked by a 'play' or a 'seek and play 1 command. Also, such a method preferably 
comprises representing at least one parameter in the same format as at least one parameter of one or both of the 
invoked commands. 

20 [0501] The method may comprise invoking a command (preferably for setting the transfer speed) as aforesaid, with 
a parameter equivalent to zero speed. Preferably, this method is a method for stopping or pausing playback of an 
audio/visual bit stream, and may itself correspond to or be invoked by a 'pause' or a 'stop' command. The invoked 
command may also cause the display of the audio/visual bit stream to be ceased. 

[0502] The method may alternatively comprise invoking a command (preferably for setting the transfer speed) as 
25 described herein, with a parameter equivalent to a greater than normal playback speed. Preferably the method is a 
method for fast -forwarding an audio/visual bit stream, and may itself correspond to or be invoked by a 'fast-forward' 
command. Furthermore, the method may comprise further invoking the command with a different parameter, for ex- 
ample to cause the bit stream to be reproduced faster the longer a 'fast-forward' button is depressed. 
[0503] The method may further comprise invoking a command (preferably for setting the transfer speed) as described 
30 herein, with a parameter equivalent to a less than normal transfer speed. The method may be a method for playing in 
slow motion an audio/visual bit stream, and may itself correspond to or be invoked by a 'slow motion' command. 
[0504] The method may further comprise invoking a command (preferably for setting the transfer speed) as described 
herein, with a parameter equivalent to a negative playback speed. Preferably the method is a method for playing in 
reverse an audio/visual bit stream, and may itself correspond to or be invoked by a 'rewind' command. 
35 [0505] Furthermore, the method may comprise invoking a command (preferably for setting the transfer speed) as 
described herein, with a parameter equivalent to a normal playback speed. Preferably this method is a method for 
resuming playback of an audio/visual bit stream, and may itself correspond to or be invoked by a 'play', 'pause' or 'un- 
pause' command. 

[0506] The method may comprise invoking a command (preferably for setting the position of reproduction) as de- 
40 scribed herein, with a parameter equivalent to the location. Preferably this method is a method for jumping to a location 
in the audio/visual bit stream, and may itself correspond to or be invoked by a 'next chapter up', 'previous chapter', 
'play', 'next index', or 'previous index' command. 

[0507] The method may comprise causing the or a further audio/visual bit stream to be stored. Thus flexibility can 
be achieved by combining methods, method steps and commands to reproduce a bit stream with the ability to store 
45 (preferably to record) the or a further bit stream. 

[0508] In a related aspect of the invention, there is provided a method of controlling the transfer of an audio/visual 
bit stream, comprising invoking at least one command as described herein (including, particularly, the commands which 
invoke further commands). 

[0509] In particular, if the method comprises a user-selectable audio/visual control operation, each command or layer 
50 of commands can itself be relatively simple, and have a relatively simple interface with the layers above and below ; 
and yet cause sophisticated low-level actions to occur in response to a single high-level user (or other) request. 
[0510] In a further aspect of the invention, there is provided apparatus controlling the transfer of an audio/visual 
bitstream, comprising means for comparing a command as described herein to a control criterion, and means for 
generating a further command in dependence upon whether the command matches the control criterion. Preferably 
55 the means for generating a further command generates a further command if the command does not match the control 
criterion. 

[0511] Preferably the command is a further command generated as aforesaid. 

[0512] Preferably, the apparatus comprises means for comparing the further command to the control criterion, and 
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means for amending the further command in dependence upon whether it matches the control criterion. 
[0513] The apparatus is preferably adapted to repeat comparison between the further command and the control 
criterion, and to repeatedly amend the further command, either up to a maximum number of repetitions or indefinitely, 
until a further command is generated which matches the control criteria. 
5 [0514] Preferably, the control criterion is dependent upon a characteristic of the transfer of the audio/visual bitstream, 
preferably of the transfer occurring at the time of receipt of the command. 

[051 5] Preferably, the characteristic of the transfer of the audio/visual bitstream is a transfer speed and or a position 
in the bitstream. 

[0516] Preferably, the control criterion is dependent upon conditional access and or parental control data. 
10 [0517] Preferably, the apparatus further comprises means for generating a control criterion as aforesaid. 

[0518] In a further aspect of the invention there is provided apparatus for controlling the transfer of an audio/visual 
bit stream, comprising means for invoking a command to set the transfer speed, and means for passing the transfer 
speed as a parameter to the command. 

[0519] In another aspect of the invention there is provided means for controlling the transfer of an audio/visual bit 
15 stream, comprising means for invoking a command to set a position from which reproduction is to take place, and 
means for passing the position as a parameter. 

[0520] In a further aspect of the invention, there is provided a computer program product for controlling the transfer 

of an audio/visual bit stream, comprising means for representing the transfer speed as a parameter. 

[0521 ] The speed may be positive, zero and/or negative. In the case where the transfer is a reproduction, if the speed 

20 is positive, the reproduction would preferably be one of normal playback, slow playback, fast forwarding, and stop/ 
pause. Alternatively, if the speed is negative, the reproduction would preferably be one of fast rewind and slow rewind. 
Thus, by allowing such a range of speeds, the flexibility offered by the method can be increased. 
[0522] If the range of speeds is limited by hardware or other considerations, the maximum speed is preferably the 
equivalent of 2, 5, 10, 50, 1 00 or 500 times a normal transfer speed. Correspondingly, the minimum speed may be the 

25 equivalent of 1 , 0, -1 , -2, -5, -1 0, -50, -1 00 or -500 times the normal transfer speed (a minimum of 0 or more preventing 
the possibility of 'rewinding' the stream, in the reproduction case, and a minimum of 0 or less opening the possibility 
of storing an audio/visual bit stream in reverse, in the recording case). The range of speeds may be a continuous range, 
allowing smooth transitions between different transfer speeds, for example, or a discrete set of speeds, for example, 
possibly taking into account hardware limitations. The parameter may, in fact, be an arbitrary speed which is converted 

30 into one of the discrete set of speeds, as appropriate, during the execution of the command or subsequently. 

[0523] The computer program product preferably further comprises means for relating the speed to the parameter 
by a multiple of a normal transfer speed (such as the normal playback speed in the reproduction case). 
[0524] Alternatively, there may be a more complex relationship between speed and parameter, whereby the computer 
program product comprises means for subtracting a constant value from either the speed or parameter, for example. 

35 [0525] Preferably the computer program product comprises means for representing a position from which the transfer 
is to take place as a parameter. This can allow further flexibility in the transfer of an audio/visual bit stream. In the case 
where the transfer is the reproduction of audio/visual data, the position from which the transfer is to take place is 
preferably an offset into the audio/visual data, and may be set to the nearest bit, byte, given other data multiple, given 
period of time, or frame of data, or may otherwise or additionally be specified in terms of programme or track numbers. 

40 Otherwise, in the recording case, for example, the position can be relative to a position on a mass storage device, 
setting the position at which recording is to start or continue. 

[0526] This important feature is also provided independently. Accordingly in a further aspect of the invention there 
is provided a computer program product for controlling the transfer of an audio/visual bit stream, comprising means 
for representing the position from which the transfer is to take place as a parameter. The set_pos() routine described 

45 later is an example of such a function. 

[0527] The parameter specifying the position from which reproduction is to take place may be related to a measure 
of time, which can free the invoking routine from calculations relating the time to the data offset in the bit stream. 
[0528] If, instead, the parameter specifying the position from which reproduction is to take place is related to an offset 
in the bit stream (or location on a mass storage device, for example), the method can be more simply implemented, 

50 resulting in a saving of memory and increasing the speed of execution. 

[0529] In another aspect of the invention, there is provided a computer program product for controlling the transfer 
of an audio visual bitstream comprising a combination of computer program products or parts of such products, as 
aforesaid. This can allow a wide range of more specialised procedures to be carried out easily, by using any of the 
above-mentioned products as building blocks. 

55 [0530] This important feature is also provided independently, and accordingly there is also provided a computer 
program productfor controlling thetransfer of an audio/visual bitstream, comprising means for representing the position 
from which reproduction is to take place as a parameter, and means for representing the transfer speed as a parameter. 
[0531] In a further related aspect of the invention, there is provided a computer program productfor controlling the 
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transfer of an audio/visual bit stream, comprising means for invoking at least one command as described herein. 
[0532] The computer program product may comprise means for selectively invoking a command as described herein 
in dependence on a state relating to the transfer of the audio/visual bit stream. Such a state could be, for example, 
whether the transfer was paused or not (in other words, whether or not the transfer speed was zero); in this case, the 
5 computer program product could, for example, comprise means for calling one further command when the transfer is 
paused, and a different further command or method step when the transfer is in progress. 

[0533] This can allow the further commands to be simplified, since they could be written without having to take into 
consideration certain values of the abovementioned state. 

[0534] Alternatively or additionally, the computer program product may comprise means for invoking a command 

10 (preferably for setting the transfer speed) as described herein, with a parameter equivalent to a normal transfer speed, 
and means for invoking a command, (preferably for setting the position of reproduction) as described herein, with a 
parameter equivalent to a position in the audio/visual bit stream. Preferably such a computer program product is linked 
to a further computer program product for starting playback in the audio/visual bit stream. Also, such a computer 
program product preferably comprises means for representing at least one parameter in the same format as at least 

15 one parameter of one or both of the invoked commands. 

[0535] The computer program product may comprise means for invoking a command (preferably means for setting 
the transfer speed) as aforesaid, with a parameter equivalent to zero speed. Preferably, this computer program product 
is linked to a computer program product for stopping or pausing playback of an audio/visual bit stream, and may itself 
correspond to or be invoked by a 'pause' or a 'stop' command. The invoked command may also cause the display of 

20 the audio/visual bit stream to be ceased. 

[0536] The computer program product may alternatively comprise means for invoking a command (preferably means 
for setting the transfer speed) as described herein, with a parameter equivalent to a greater than normal playback 
speed. Preferably the computer program product is linked to a further computer product for fast-forwarding an audio/ 
visual bit stream, and may itself correspond to or be invoked by a 'fast-forward' command. Furthermore, the computer 

25 program product may comprise means for further invoking the command with a different parameter, for example to 
cause the bit stream to be reproduced faster the longer a 'fast-forward' button is depressed. 

[0537] The computer program product may further comprise means for invoking a command (preferably means for 
setting the transfer speed) as described herein, with a parameter equivalent to a less than normal transfer speed. 
Preferably the computer program product is linked to a further computer program product playing in slow motion an 

30 audio/visual bit stream, and may itself correspond to or be invoked by a 'slow motion' command. 

[0538] The computer program product may further comprise means for invoking a command (preferably means for 
setting the transfer speed) as described herein, with a parameter equivalent to a negative playback speed. Preferably 
the computer program product is linked to a computer program productfor playing in reverse an audio/visual bit stream, 
and may itself correspond to or be invoked by a 'rewind' command. 

35 [0539] Furthermore, the computer program product may comprise means for invoking a command (preferably means 
for setting the transfer speed) as described herein, with a parameter equivalent to a normal playback speed. Preferably 
the computer program product is linked to a computer program product for resuming playback of an audio/visual bit 
stream, and may itself correspond to or be invoked by a 'play', 'pause' or 'un-pause' command. 
[0540] The computer program product may comprise means for invoking a command (preferably means for setting 

40 the position of reproduction) as described herein, with a parameter equivalent to the location. Preferably the computer 
program product is linked to a computer program product for jumping to a location in the audio/visual bit stream, and 
may itself correspond to or be invoked by a 'next chapter up', 'previous chapter', 'play', 'next index', or 'previous index' 
command. 

[0541] The computer program product may comprise means for causing the or a further audio/visual bit stream to 
45 be stored. Thus flexibility can be achieved by combining methods, method steps and commands to reproduce a bit 
stream with the ability to store (preferably to record) the or a further bit stream. 

[0542] In a related aspect of the invention, there is provided a computer program product for controlling the transfer 
of an audio/visual bit stream, comprising means for invoking at least one command as described herein (including, 
particularly, the commands which invoke further commands). 
50 [0543] In particular, if the computer program product comprises means for effecting a user-selectable audio/visual 
control operation, each command or layer of commands can itself be relatively simple, and have a relatively simple 
interface with the layers above and below, and yet cause sophisticated low-level actions to occur in response to a 
single high-level user (or other) request. 

[0544] In a further aspect of the invention, there is provided a computer program product for controlling the transfer 
55 of an audio/visual bitstream, comprising means for comparing a command as described herein to a control criterion, 
and means for generating afurther command in dependence upon whetherthe command matches the control criterion. 
Preferably the means for generating a further command generates a further command if the command does not match 
the control criterion. 
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[0545] Preferably the command is a further command generated as aforesaid. 

[0546] Preferably, the computer program product comprises means for comparing thef urther command to the control 
criterion, and means for amending the further command in dependence upon whether it matches the control criterion. 
[0547] The computer program product is preferably adapted to repeat comparison between the further command 
5 and the control criterion, and to repeatedly amend the further command, either up to a maximum number of repetitions 
or indefinitely, until a further command is generated which matches the control criteria. 

[0548] Preferably, the control criterion is dependent upon a characteristic of the transfer of the audio/visual bitstream, 
preferably of the transfer occurring at the time of receipt of the command. 

[0549] Preferably, the characteristic of the transfer of the audio/visual bitstream is a transfer speed and or a position 
10 in the bitstream. 

[0550] Preferably, the control criterion is dependent upon conditional access and or parental control data. 
[0551 ] Preferably, the computer program product further comprises means for generating a control criterion as afore- 
said. 

[0552] In a further aspect of the invention there is provided a computer program product for controlling the transfer 
15 of an audio/visual bit stream, comprising means for invoking a command to set the transfer speed, and means for 
passing the transfer speed as a parameter to the command. 

[0553] In another aspect of the invention there is provided a computer program product for controlling the transfer 
of an audio/visual bit stream, comprising means for invoking a command to set a position from which reproduction is 
to take place, and means for passing the position as a parameter. 
20 [0554] In a further related aspect of the invention, there is provided an operating system, comprising at least one 
command as aforesaid, and preferably adapted to carry out a method as described herein. 

[0555] In another aspect of the invention, there is provided a receiver/decoder, comprising at least one command 
as aforesaid, and preferably adapted to carry out a method as described herein. 

[0556] In a yet further aspect of the invention, there is provided a receiver/decoder, adapted to invoke at least one 
25 command as aforesaid. 

[0557] In another aspect of the invention, there is provided a computer program product, comprising at least one 
command as aforesaid. 

[0558] In a further aspect of the invention, there is provided a computer readable medium, comprising a computer 
program product as aforesaid. 

30 [0559] In another aspect of the invention, there is provided a signal, tangibly embodying a computer program product 
as aforesaid. 

[0560] In a further aspect of the invention, there is provided apparatus for processing audio/visual data, comprising 
means (such as an input) for receiving audio/visual data, means (such as an output) for outputting audio/visual data, 
and means (such as a processor and associated memory) for executing at least one command as aforesaid and/or for 
35 carrying out a method as aforesaid. 

[0561] In a related aspect of the invention, there is provided apparatus for processing audio/visual data, comprising 
an input, an output, and a processor and associated memory, the processor being adapted to execute at least one 
command as aforesaid, and/or adapted to carry out a method as described herein. 

[0562] In another aspect of the invention, there is provided an audio/visual processing device, comprising apparatus 
40 as aforesaid. 

[0563] In another aspect of the invention there is provided a broadcast system, comprising a receiver/decoder as 
aforesaid. 

[0564] In another aspect of the invention there is provided an index table comprising indices mapping time offsets 

in a bitstream to data offsets in a file. 
45 [0565] Preferably the index table is a table as described herein. 

[0566] In another aspect of the invention there is provided a method of generating an index table as aforesaid. There 

are also provided, in further aspects of the invention, a computer program product for generating and/or storing an 

index table as aforesaid, and apparatus comprising means for generating an index table as aforesaid and/or means 

for storing an index table as aforesaid. 
50 [0567] In another aspect of the invention there is provided a computer program product for creating an index table 

comprising means for creating indices mapping time offsets in a bitstream to data offsets in a file. 

[0568] Preferably the index table is a table as described herein. 

[0569] In another aspect of the invention there is provided a computer program product for generating an index table 
as aforesaid. There are also provided, in further aspects of the invention, a computer program product for generating 
55 and/or storing an index table as aforesaid, and apparatus comprising means for generating an index table as aforesaid 
and/or means for storing an index table as aforesaid. 

[0570] In a further aspect of the invention there is provided a hard disk video recorder (HDVR) adapted to receive a 
command from a client in response to a user input. Such a command may be a command to start recording a particular 
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programme. The client may be a personal video recorder (PVR) application, for example. 

[0571] Preferably the HDVR interacts in parallel with a service device and a storage device, preferably a file system 
library. Preferably such interaction sets up and synchronises parts of a receiver/decoder handling a bitstream to be 
recorded or played back, and/or coordinates the recording or playback operation at appropriate places on a hard disk. 
5 [0572] Preferably, the hard disk video recorder (HDVR) is further adapted to receive a command to start recording 
a particular programme. 

[0573] The hard disk video recorder (HDVR) may be adapted to interact with a device, preferably a service device 
and/or to interact with a file system library. 

[0574] Preferably, the hard disk video recorder (HDVR) is adapted to send or receive a further command, in order 
10 to interact with the service device and/or the file system library. 

[0575] The command or the further command may cause the generation of a further command. 

[0576] Preferably, the command or the further command is a command as described herein. 

[0577] The invention extends to methods and/or apparatus substantially as herein described with reference to the 

accompanying drawings. 

15 [0578] Any feature in one aspect of the invention may be applied to other aspects of the invention, in any appropriate 
combination. In particular method aspects may be applied to apparatus aspects, and vice versa. 
[0579] Furthermore, features implemented in hardware may generally be implemented in software, and vice versa. 
Any reference to software and hardware features herein should be construed accordingly. 

[0580] Preferred features of the present invention will now be described, purely by way of example, with reference 
20 to the accompanying drawings, in which:- 

Figure 1 is an overview of a satellite digital television system; 

Figure 2 is an overview of a cable digital television system; 

Figure 3 is an overall system view, with the head-end shown in more detail; 
25 Figure 4 is a schematic of the component architecture of the receiver/decoder; 

Figure 5 is a diagram of the software architecture of the receiver/decoder: 

Figure 6 is a diagram showing the top half of Figure 5 in more detail; 

Figure 7 is a diagram showing the bottom half of Figure 5 in more detail; 

Figure 8 is a diagram showing an alternative embodiment of the bottom half of Figure 5; 
30 Figure 9 is an overview of a content management and protection system; 

Figure 10 is an alternative arrangement of the content management and protection system; 

Figure 11 is an illustration of the software architecture of the content management and protection system; 

Figure 12 is an illustration of the recording of encrypted content to a mass storage device; 

Figure 13 is an illustration of the playback of encrypted content from a mass storage device; 
35 Figure 1 4 is a graph of bitrate versus time for a variable bitrate bitstream; 

Figure 15 is a schematic illustration of an MPEG-2 bitstream as a function of time; 

Figure 16 is a representation of data offsets, with corresponding bitstream time offsets, for a file containing a 
representation of a variable bitrate bitstream; 

Figure 17 is a schematic diagram showing the correspondence between points in a bitstream and points in a file 
40 comprising a representation of the bitstream. 

Figure 18 is a schematic diagram illustrating searching for a point in file using HDVR indices; 

Figure 1 9 is a schematic diagram illustrating a fast-forwarding operation comprising skipping between periodically 

spaced points in a bitstream; 

Figure 20 is a schematic diagram illustrating a fast-forwarding operation comprising skipping between periodically 
45 spaced points in a bitstream, and locating the closest following key frames to these periodically spaced points; 

Figure 21 is a graph of bitrate versus time for a variable bitrate bitstream, showing portions of a bitstream above 
a selected value; 

Figure 22 is an illustration of the interpolation of HDVR index points upon recording; 

Figure 23 is an illustration of a discrepancy between HDVR index information and inserted ECM sections; 
50 Figure 24 is a schematic diagram of part of a file, including an Hfmd section; 

Figure 25 is an overview of the flow of data between the CM PS and the HDVR in a preferred embodiment; 

Figure 26 is an illustration of the structure of a typical bit stream; 

Figure 27 is a diagram showing an estimation process as described herein; 

Figure 28 is a further diagram showing the estimation process; 
55 Figure 29 is a yet further diagram showing the estimation process; 

Figure 30 is a schematic of the bit stream recording process; 

Figure 31 is a schematic of the bit stream playback process; 

Figures 32 are an illustration of filtering a sinusoidal bit stream using a rapid filter; 
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Figures 33 are an illustration of filtering a sinusoidal bit stream using an inertial filter; 
Figures 34 are an illustration of filtering a sinusoidal bit stream using a hybrid filter; 
Figures 35 are an illustration of filtering a sinusoidal bit stream using a static filter; 
Figures 36 are an illustration of filtering a constant bit rate bit stream using a hybrid filter; 
5 Figures 37 are an illustration of filtering a triangular bit stream using a hybrid filter; 

Figures 38 are an illustration of filtering a top hat bit stream using a hybrid filter; and 
Figures 39 are an illustration of filtering a peak in a bit stream using a hybrid filter. 
Figure 40 is a schematic of a personal video recorder system; 

Figure 41 is a schematic of three layers of commands for a personal video recorder system; 
10 Figure 42 is an illustration of a conventional fast-forward operation; 

Figure 43 is an illustration of a first alternative fast-forward operation; 

Figure 44 is an illustration of a further fast-forward operation; 

Figure 45 is an illustration of a first rewind operation; 

Figure 46 is an illustration of a further rewind operation; 
15 Figure 47 is an illustration of a slow-play operation; and 

Figure 48 is an illustration of an alternative slow-play operation. 

System overview 

20 [0581] An overview of a digital television system 500 is shown in Figure 1 . As will be discussed below, the system 
500 comprises a broadcast centre 1000, a receiver/decoder 2000, a software/hardware architecture 3000 of the re- 
ceiver/decoder, an interactive system 4000, and a conditional access system 5000, as will all be discussed below. 
[0582] The system 500 includes a mostly conventional digital television system 502 that uses the known MPEG-2 
compression system to transmit compressed digital signals. In more detail, MPEG-2 compressor 1 01 0 in a broadcast 

25 centre 1 000 receives a digital signal stream (typically a stream of video signals). The compressor 1 01 0 is connected 
by linkage 1 020 to a multiplexer and scrambler 1 030. 

[0583] The multiplexer 1 030 receives a plurality of further input signals, assembles the transport stream and transmits 
compressed digital signals to a transmitter 1 01 0 of the broadcast centre via linkage 1 022, which can of course take a 
wide variety of forms including telecommunications links. The transmitter 510 transmits electromagnetic signals via 
30 uplink 514 towards a satellite transponder 520, where they are electronically processed and broadcast via notional 
downlink516to earth receiver 51 2, conventionally in the form of a dish owned or rented by the end user. Other transport 
channels for transmission of the data are of course possible, such as terrestrial broadcast, cable transmission, com- 
bined satellite/cable links, telephone networks etc. 

[0584] The signals received by receiver 51 2 are transmitted to an integrated receiver/decoder 2000 owned or rented 
35 by the end user and connected to the end user's television set 10000. The receiver/decoder 2000 decodes the com- 
pressed MPEG-2 signal into a television signal for the television set 10000. Although a separate receiver/decoder is 
shown in Figure 1 , the receiver/decoder may also be part of an integrated digital television. As used herein, the term 
"receiver/decoder" includes a separate receiver/decoder, such as a set-top box, and a television having a receiver/ 
decoder integrated therewith. 

40 [0585] In the receiver/decoder 2000 a hard disk 21 00 is provided, on which audiovisual and other data can be stored. 
This allows advanced recording and playback facilities for programmes received by the receiver/decoder, and also 
allows large amounts of other types of data, such as electronic programme guide data, to be stored in the receiver/ 
decoder. 

[0586] A content management and protection system (CM PS) 2300 (not shown) in the receiver/decoder provides 
45 the ability securely and flexibly to control the recording and playback of data on the hard disk 21 00 (or other storage 
device). 

[0587] In a multichannel system, the multiplexer 1 030 handles audio and video information received from a number 
of parallel sources and interacts with the transmitter 51 0 to broadcast the information along a corresponding number 
of channels. In addition to audiovisual information, messages or applications or any other sort of digital data may be 

50 introduced in some or all of these channels interlaced with the transmitted digital audio and video information. 

[0588] An interactive system 4000 is connected to the multiplexer 1 030 and the receiver/decoder 2000, and is located 
partly in the broadcast centre and partly in the receiver/decoder. It enables the end user to interact with various appli- 
cations via a back channel 570. The back channel may be, for example a Public Switched Telephone Network (PSTN) 
channel (for example, a modemmed back channel) or an Out of Band (OOB) channel. 

55 [0589] A conditional access system 5000, also connected to the multiplexer 1030 and the receiver/decoder 2000 
and again located partly in the broadcast centre and partly in the receiver/decoder, enables the end user to access 
digital television broadcasts from one or more broadcast suppliers. A smartcard, capable of deciphering messages 
relating to commercial offers (that is, one or several television programmes sold by the broadcast supplier), can be 
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inserted into the receiver/decoder 2000. Using the receiver/decoder 2000 and smartcard, the end user may purchase 
commercial offers in either a subscription mode or a pay-per-view mode. Typically this is achieved using the back 
channel 570 which is used by the interactive system 4000. 

[0590] As mentioned above, programmes transmitted by the system are scrambled at the multiplexer 1030, the 
5 conditions and encryption keys applied to a given transmission being determined by the access control system 5000. 
Transmission of scrambled data in this way is well known in the field of pay TV systems. Typically, scrambled data is 
transmitted together with a control word for descrambling of the data, the control word itself being encrypted by a so- 
called exploitation key and transmitted in encrypted form. 

[0591] The scrambled data and encrypted control word are then received by the receiver/decoder 2000 having access 
10 to an equivalent to the exploitation key stored on a smartcard inserted in the receiver/decoder to decrypt the encrypted 
control word and thereafter descramble the transmitted data. A paid-up subscriber will receive, for example, in a broad- 
cast monthly EMM (Entitlement Management Message) the exploitation key necessary to decrypt the encrypted control 
word so as to permit viewing of the transmission. 

[0592] Figure 2 illustrates an alternative embodiment of a digital television system 504, utilising a cable network as 
15 the broadcast medium for the compressed digital signals. In this figure, like parts are indicated with like numerals. 
[0593] The satellite transponder and transmitting and receiving stations are replaced by a cable network 550. Addi- 
tionally, in this particular embodiment, the modemmed back channel between the receiver/decoder 2000 and the in- 
teractive system 4000 and conditional access system 5000 is removed, replaced by linkages 554, 556 between the 
cable network 550 and the conditional access system 5000 and interactive system 4000 respectively. The receiver/ 
20 decoder 2000 thus communicates with the other systems via the cable network 550, utilising a cable modem or other 
means to allow it to send and receive data via the same link as it receives data from the broadcast centre. 
[0594] The cable network 550 may be any form of wide area network (WAN), such as a dedicated connection, the 
internet, local cable distribution network, wireless connection, or any combination of the above. In the present embod- 
iment, the hybrid fibre coax (HFC) network is used. It is appreciated that the various means of communication between 
25 the receiver/decoder 2000 and the other components of the television system are interchangeable. 

Conditional access system 

[0595] With reference to Figure 3, in overview the conditional access system 5000 includes a Subscriber Authoriza- 
30 tion System (SAS) 5200. The SAS 5200 is connected to one or more Subscriber Management Systems (SMS) 1100, 
one SMS for each broadcast supplier, by a link 1044, which may be a TCP-IP link or other type of link. Alternatively 
one SMS could be shared between two commercial operators, or one operator could use two SMSs, and so on. 
[0596] First encrypting units in the form of ciphering units 51 00 utilising "mother" smartcards 51 1 0 are connected to 
the SAS by linkage 1042. Second encrypting units again in the form of ciphering units 51 02 utilising mother smartcards 
35 5112 are connected to the multiplexer 1 030 by linkage 1 040. The receiver/decoder 2000 receives a "daughter" smart- 
card 5500. The receiver/decoder is connected directly to the SAS 5200 via communications servers 1200 and the 
modemmed back channel 570. The SAS sends amongst other things subscription rights to the daughter smartcard on 
request. 

[0597] In variants of the preferred embodiment, internet or cable connections either complement or replace the PSTN 
40 570 and communications servers 1200. 

[0598] The smartcards contain confidential information from one or more commercial operators. The "mother" smart- 
card encrypts different kinds of messages and the "daughter" smartcards decrypt the messages, if they have the rights 
to do so. 

[0599] With reference to Figure 3, in the broadcast centre, the digital video signal is first compressed (or bit rate 
45 reduced), using the MPEG-2 compressor 1010. This compressed signal is then transmitted to the multiplexer and 
scrambler 1030 in order to be multiplexed with other data, such as other compressed data. 

[0600] The scrambler generates a control word used in the scrambling process and included in the MPEG-2 stream 
in the multiplexer 1 030. The control word is generated internally and enables the end user's integrated receiver/decoder 
2000 to descramble the programme. 

50 [0601] Access criteria, indicating howthe programme is commercialised, are also added to the MPEG-2 stream. The 
programme may be commercialised in either one of a number of "subscription" modes and/or one of a number of "Pay 
Per View" (PPV) modes or events. In the subscription mode, the end user subscribes to one or more commercial offers, 
or "bouquets", thus getting the rights to watch every channel inside those bouquets. In the Pay Per View mode, the 
end user is provided with the capability to purchase events as he wishes. 

55 [0602] Both the control word and the access criteria are used to build an Entitlement Control Message (ECM); this 
is a message sent in relation with one scrambled program; the message contains a control word (which allows for the 
descrambling of the program) and the access criteria of the broadcast program. The access criteria and control word 
are transmitted to the second encrypting unit 5102 via the linkage 1 040. In this unit, an ECM is generated, encrypted 
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and transmitted on to the multiplexer and scrambler 1 030. 

[0603] Each service broadcast by a broadcast supplier in a data stream comprises a number of distinct components; 
for example a television programme includes a video component, an audio component, a sub-title component and so 
on. Each of these components of a service is individually scrambled and encrypted for subsequent broadcast. In respect 

5 of each scrambled component of the service, a separate ECM is required. 

[0604] The multiplexer 1 030 receives electrical signals comprising encrypted EMMs from the SAS 5200, encrypted 
ECMs from the second encrypting unit 51 02 and compressed programmes from the compressor 1010. The multiplexer 
1030 scrambles the programmes and transmits the scrambled programmes, the encrypted EMMs and the encrypted 
ECMs as electric signals to broadcast system 600, which may be for example a satellite system as shown in Figure 

10 1 , or other broadcast system. The receiver/decoder 2000 demultiplexes the signals to obtain scrambled programmes 
with encrypted EMMs and encrypted ECMs. 

[0605] The receiver/decoder receives the broadcast signal and extracts the MPEG-2 data stream. If a programme 
is scrambled, the receiver/decoder 2000 extracts the corresponding ECM from the MPEG-2 stream and passes the 
ECM to the "daughter" smartcard 5500 of the end user. This slots into a housing in the receiver/decoder 2000. The 

15 daughter smartcard 5500 controls whetherthe end user has the right to decrypt the ECM and to access the programme. 
If not, a negative status is passed to the receiver/decoder 2000 to indicate that the programme cannot be descrambled. 
If the end user does have the rights, the ECM is decrypted and the control word extracted. The decoder 2000 can then 
descramble the programme using this control word. The MPEG-2 stream is decompressed and translated into a video 
signal for onward transmission to television set 1 0000. 

20 [0606] If the programme is not scrambled, no ECM will have been transmitted with the MPEG-2 stream and the 
receiver/decoder 2000 decompresses the data and transforms the signal into a video signal for transmission to tele- 
vision set 10000. 

[0607] The subscriber management system (SMS) 1 1 00 includes a database 1 1 50 which manages, amongst others, 
all of the end user files, commercial offers (such as tariffs and promotions), subscriptions, PPV details, and data re- 

25 garding end user consumption and authorization. The SMS may be physically remote from the SAS. 

[0608] The SMS 11 00 transmits messages to the SAS 5200 which imply modifications to or creations of Entitlement 
Management Messages (EMMs) to be transmitted to end users. The SMS 1 1 00 also transmits messages to the SAS 
5200 which imply no modifications or creations of EMMs but imply only a change in an end user's state (relating to the 
authorization granted to the end user when ordering products or to the amount that the end user will be charged). The 

30 SAS 5200 also sends messages (typically requesting information such as call-back information or billing information) 
to the SMS 1 1 00, so that it will be apparent that communication between the two is two-way. 

Receiver/decoder 

35 [0609] Referring to Figure 4, the various elements of receiver/decoder 2000 will now be described in terms of func- 
tional blocks. 

[0610] The receiver/decoder 2000, which may be, for example, a digital set-top box (DSTB), comprises a central 
host processor 2002 and a digital TV coprocessor 2004, both having associated memory elements (not shown) and 
joined by a coprocessor bus 2006. The coprocessor 2004 is adapted to receive input data from a USB interface 2070, 
40 a serial interface 2072, a parallel interface (not shown), a modem 2074 (connected to the modem back channel 570 
of Fig. 1), and switch contacts on the front panel 2054 of the decoder. 

[0611] The receiver/decoder is additionally adapted to receive inputs from an infra-red remote control 2080 (and 
optionally from other wireless peripherals 2082 such as Bluetooth-enabled devices) and also possesses two smartcard 
readers 2050, 2052 adapted to read bank and subscription smartcards 2060, 2062 respectively. The subscription 

45 smartcard reader2052 engages with an inserted subscription card 2062 and with a conditional access unit (not shown) 
to supply the necessary control word to a demultiplexer/descrambler/remultiplexer unit 201 0 to enable the encrypted 
broadcast signal to be descrambled. The decoder also includes a conventional tuner 201 6 and demodulator 201 2 to 
receive and demodulate the satellite transmission before being filtered and demultiplexed by the demodulator/descram- 
bler unit 2010. A second tuner 201 8 and second demodulator 2014 are also provided, to allow, amongst other things, 

50 a second channel to be received and decoded in parallel with the first. 

[061 2] A hard disk 21 00 is also provided, allowing storage of programme and application data received and generated 
by the receiver/decoder. In conjunction with the two tuners 201 6. 201 8, two demodulators 201 2, 201 4, the descrambler/ 
demultiplexer/remultip lexer 2010, and the data decoder 2024 and audio decoder 2026, advanced recording and play- 
back features are provided, allowing simultaneous recordings of one or more programmes while a further programme 

55 is being viewed, and more general transfers to and from the hard disk to and from the display devices and/or inputs 
and outputs, all occurring in parallel. 

[0613] The audio output 2038 and video output 2040 in the receiver/decoder are fed by the PCM mixer 2030 and 
audio DAC2034, and the MPEG video decoder 2028, graphic engine 2032 and PAL/SECAM encoder 2036 respectively. 
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Alternative or complementary outputs may of course be provided. 

[0614] As used in this description, an application is preferably a piece of computer code for controlling high level 
functions of preferably the receiver/decoder 2000. For example, when the end user positions the focus of remote control 
2080 on a button object seen on the screen of the television set (not shown) and presses a validation key, the instruction 
5 sequence associated with the button is run. Applications and the associated middleware are executed by the host 
processor 2002, with remote procedure calls (RPCs) being made to the digital TV coprocessor 2004 across the co- 
processor bus 2006 as and when required. 

[0615] An interactive application proposes menus and executes commands at the request of the end user and pro- 
vides data related to the purpose of the application. Applications may be either resident applications, that is, stored in 
10 the ROM (or FLASH or other non-volatile memory) of the receiver/decoder 2000, or broadcast and downloaded into 
the RAM, FLASH memory or hard disk of the receiver/decoder 2000. 

[0616] Applications are stored in memory locations in the receiver/decoder 2000 and represented as resource files. 
The resource files comprise graphic object description unit files, variables block unit files, instruction sequence files, 
application files and data files. 

15 [0617] The receiver/decoder contains memory (not shown) divided into at least one RAM volume, a FLASH volume 
and at least one ROM volume, but this physical organization is distinct from the logical organization. The memory may 
further be divided into memory volumes associated with the various interfaces. From one point of view, the memory 
can be regarded as part of the hardware; from another point of view, the memory can be regarded as supporting or 
containing the whole of the system shown apart from the hardware. 

20 

Architecture of receiver/decoder 

[0618] With reference to Figure 5, the software/hardware architecture 3000 of the receiver/decoder contains five 
software layers, organized so that the software can be implemented in any receiver/decoder and with any operating 
25 system. The various software layers are application layer 31 00, application programming interface (API) layer 3300, 
virtual machine layer 3500, device interface layer 3700 (often abbreviated just to 'device layer 1 ) and system software/ 
hardware layer 3900. 

[061 9] The application layer 31 00 encompasses applications 31 20 that are either resident in or downloaded to the 
receiver/decoder. They may be interactive applications used by customers, written in, for example, Java, HTML, MH EG- 

30 5 or other languages, or they may be applications used by the receiver/decoder for other purposes, for example for 
running such interactive applications. This layer is based on a set of open Application Programming Interfaces (APIs) 
provided by the Virtual Machine layer. This system allows applications to be downloaded to the hard disk, flash memory 
or RAM memory in the receiver/decoder on-the-fly or on demand. The application code can be transmitted in com- 
pressed or uncompressed format using protocols such as Data Storage Media Command and Control (DSMCC), Net- 

35 work File Server (NFS) or other protocols. 

[0620] The API layer 3300 provides high-level utilities for interactive application development. It includes several 
packages that make up this high-level API. The packages provide all the functionality necessary to run interactive 
applications. The packages are accessible by the applications. 

[0621] In a preferred embodiment the API is adapted for applications written in the Java, PanTalk or such similar 
40 programming languages. Furthermore, it can facilitate the interpretation of HTML and other formats, such as MHEG- 
5. Besides these features, it also includes other packages and service modules that are detachable and extensible as 
requirements dictate. 

[0622] The virtual machine layer 3500 is composed of language interpreters and various modules and systems. This 
layer, managed by a kernel 3650 (not shown), consists of everything necessary to receive and execute interactive 

45 applications in the receiver/decoder. 

[0623] The device interface layer 3700 includes a Device Manager and software devices (generally referred to herein 
as just 'devices'). Devices are software modules which consist of the logical resources necessary for management of 
external events and physical interfaces. The device interface layer, under the control of the Device Manager, manages 
communication channels between drivers and applications and provides enhanced error exception checking. Some 

50 examples of managed (hardware) devices are: card readers 3722 (not shown), modems 3730 (not shown), network 
3732 (not shown), PCMCIA (Personal Computer Memory Card International Association), LED display and so on. 
Programmers do not have to deal with this layer directly, since the API layer controls the devices from above. 
[0624] The system software/hardware layer 3900 is provided by the manufacturer of the receiver/decoder. Because 
of the modularity of the system and because services supplied by the higher-level operating system (such as event 

55 scheduling and memory management) are part of the virtual machine and kernel, the higher layers are not tied to a 
particular real-time operating system (RTOS) or to a particular processor. 

[0625] Typically the virtual machine layer 3500, occasionally in combination with the device interface layer 3700 and/ 
or API 3300, is referred to as the 'middleware' of the receiver/decoder. 
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[0626] With reference to Figure 6 the software architecture of the receiver/decoder 3000 corresponding to the top 
half of Figure 5 (comprising the application layer 3100, API layer 3300 and virtual machine layer 3500) will now be 
described in more detail. 

[0627] Interactive applications are applications that the user interacts with, for example, to obtain products and serv- 
5 ices, such as electronic program guides, telebanking applications and games. 

[0628] There are two types of application in the application layer 31 00, plus the Application Manager 3110. There 
are interactive applications such as a Web Browser 3130 which can be added at any time as long as they conform to 
the API 3300, and there are resident applications which manage and support the interactive applications. The resident 
applications are substantially permanent and include the following: 

10 

• Boot. The Boot application 3142 is the first application launched when the receiver/decoder is powered on. The 
Boot application first starts the Application Manager 3110, and then starts the "Manager" software modules in the 
virtual machine 3500, such as the Memory Manager 3544 and the Event Manager 3546. 

• Application Manager. The Application Manager 3110 manages the interactive applications that are run in the re- 
15 ceiver/decoder, that is, it starts, stops, suspends, resumes, handles events and deals with communication between 

applications. It allows multiple applications to run at once, and thus is involved in the allocation of resources among 
them. This application is completely transparent to the user. 

• SetUp. The purpose of the SetUp application 31 44 is to configure the receiver/decoder, primarily the first time it 
is used. It performs actions such as scanning for TV channels, setting the date and time, establishing user pref- 

20 erences, and so on. However, the SetUp application can be used at anytime by the user to change the receiver/ 

decoder configuration. 

• Zapping. The Zapping application 3146 is used to change channels using the Program-up, Program-down and 
numeric keys. When another form of zapping is used, for example, through a banner (pilot) application, the Zapping 
application is stopped. 

25 • Callback. The Callback application 3148 is used to extract the values of various parameters stored in the receiver/ 
decoder memory and return these values to the commercial operator via modemmed back channel 1070 (not 
shown), or by other means. 

[0629] Other applications in the application layer 3100 include a program guide application 3132, a pay-per-view 
30 application 3134, a banner (pilot) application 3136, a home banking application 3138, a software download application 
3140 and a PVR (personal video recorder) application 3154 (see below). 

[0630] As noted above, the Application Programming Interface (API) layer 3300 contains several packages. These 
include basic system packages 3310, used, for example, to access basic features of the virtual machine, DAVIC pack- 
ages 3320, and proprietary packages 3330, used to access features of the software architecture unique to the principal 
35 software vendor. 

[0631] Considered in more detail, the virtual machine 3500 includes the following: 

• Language Interpreters 3510. Different interpreters can be installed to conform to the type of applications to be 
read. These include Java interpreters 3512, PanTalk interpreters 3514, HTML interpreters 3516, MHEG-5 inter- 
ne preters 351 8 and others. 

• Service Information (SI) Engine. The SI Engine 3540 loads and monitors common Digital Video Broadcasting 
(DVB) or Program System Information Protocol (PSIP) tables and puts them into a cache. It allows access to these 
tables by applications which need the data contained in them. 

• Scheduler 3542. This module allows for pre-emptive, multithreaded scheduling with each thread having its own 
45 event queue. 

• Memory Manager 3544. This module manages the access to memory. It also automatically compresses data in 
memory when necessary and performs automatic garbage collection. 

• Event Manager 3546. This module allows events to be triggered according to priority. It manages timer and event 
grabbing and allows applications to send events to each other. 

50 • Dynamic Linker 3548. This module allows the resolution of addresses arising from native Java functions, loads 
native methods from a Java class downloaded into RAM and resolves calls from downloaded native codes towards 
ROM. 

• Graphics System 3550. This system is object-orientated and optimized. It includes graphic window and object 
management as well as a vectorial font engine with multi-language support. 

55 • Class Manager 3552. This module loads classes and resolves any class referencing problems. 

• File System 3554. This module is compact and optimized to manage a hierarchical file system with multiple ROM, 
flash, RAM and DSMCC volumes. Flash integrity is guaranteed against any incidents. 

• Security Manager 3556. This module authenticates applications and controlsthe access of applications to sensitive 
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memory and other zones of the set-top box. 
• Downloader 3558. This module uses automatic data loading from a remote DSMCC carousel or through the NFS 
protocol, with downloaded files accessed in the same way as resident ones. Memory clear-up, compression and 
authentication are also provided. 

5 

[0632] Furthermore, the DAVIC resource notification model is supported so that client resources are efficiently man- 
aged. 

[0633] A kernel 3650 manages the various different processes running in the virtual machine 3500 and device inter- 
face layer 3700 (not shown). For efficiency and reliability reasons, the kernel implements relevant parts of the POSIX 

10 standard for operating systems. 

[0634] Under control of the kernel, the virtual machine (running Java and Pantalk applications) runs in its own thread, 
separate to other 'server' elements of the operating system, such as the mass storage server 3850 (not shown). Cor- 
responding provisions, such as requiring Thread IDs to be passed as parameters in system calls, are also made in the 
API layer 3300 to allow the applications 31 20 to benefit from the multithreaded environment. 

15 [0635] By providing multiple threads, more stability can be achieved. For example, if the virtual machine 3500 ceases 
to operate for some reason, by suffering a crash or being blocked for a long time by an application trying to access a 
device, other time-critical parts of the system, such as the hard disk server, can continue to operate. 
[0636] As well as the virtual machine 3500 and kernel 3650, a hard disk video recorder (HDVR) module 3850 is 
provided for handling the recording and playback functions of the hard disk 2210 or other attached mass storage 

20 component. The server comprises two separate threads 3854, 3856 handling recording, one thread 3858 for handling 
playback, and a file system library 3852 for interfacing with the mass storage components. 

[0637] An appropriate one of the threads 3854, 3856, 3858 in the hard disk video recorder (HDVR) 3850 receives 
commands (such as a command to start recording a particular programme) from clients such as the personal video 
recorder (PVR) application 3154, in response to the user pressing a 'record' button, for example. 
25 [0638] In turn, the thread in question then interacts with the service device 3736 (shown in Figure 7) to set up and 
synchronise the parts of the receiver/decoder handling the bitstream to be recorded or played back. In parallel, the 
thread also interacts with the file system library 3852 to coordinate the recording or playback operation at appropriate 
places on the hard disk 221 0 (not shown). 

[0639] The file system library 3852 then sends commands to the mass storage device 3728 (also shown in Figure 
30 7) which tell the mass storage device 3728 which sub-transport stream (STS) to transfer (via a FIFO buffer), and on 
which hard disk target the stream should be stored. Allocation of clusters on the hard disk and general file management 
is carried out by the file system library 3852, the mass storage device itself being concerned with lower level operations. 
[0640] The service device 3736 mentioned above is unique amongst the devices in that it does not relate to a physical 
component of the receiver/decoder. It instead provides a high level interface which groups together in a single 'instance' 
35 the various sets of tuner, demultiplexer, remultiplexer and hard disk devices in the receiver/decoder, freeing higher 
level processes from the difficulties of coordinating the various sub-devices. 

[0641] With reference to Figure 7 the software architecture of the receiver/decoder 3000 corresponding to the bottom 
half of Figure 5 (comprising the device interface layer 3700 and the system software and hardware layer 3900) will 
now be described in more detail. 
40 [0642] Further devices provided in the device layer include the conditional access device 3720, tuner devices 3724 
corresponding to the two (or potentially more) tuners 201 6, 201 8 of Figure 4, the video device 3734, the I/O port device 
3726, and the service device 3736 and mass storage device 3728 mentioned above. 

[0643] In broad terms, a device can be regarded as defining a logical interface, so that two different devices may be 
coupled to a common physical port. Certain devices may communicate among themselves, and all devices also operate 

45 under the control of the kernel 3650. 

[0644] Before using the services of any device, a program (such as an application instruction sequence) has to be 
declared as a "client", that is, a logical access-way to the device or the device manager 371 0. The manager gives the 
client a client number which is referred to in all accesses to the device. A device can have several clients, the number 
of clients for each device being specified depending on the type of device. A client is introduced to the device by a 

50 procedure "Device: Open Channel". This procedure assigns a client number to the client. A client can be taken out of 
the device manager 3710 client list by a procedure "Device: Close Channel". 

[0645] The access to devices provided by the device manager 3710 can be either synchronous or asynchronous. 
For synchronous access, a procedure "Device: Call" is used. This is a means of accessing data which is immediately 
available or a functionality which does not involve waiting for the desired response. For asynchronous access, a pro- 
55 cedure "Device: I/O" is used. This is a means of accessing data which involves waiting for a response, for example 
scanning tuner frequencies to find a multiplex or getting back a table from the MPEG stream. When the requested 
result is available, an event is put in the queue of the engine to signal its arrival. A further procedure "Device: Event" 
provides a means of managing unexpected events. 
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[0646] In a second embodiment of the receiver/decoder, the lower half of the architecture of the receiver/decoder is 
replaced by the layers shown in Figure 8. 

[0647] In this embodiment, an extended device layer interface (EDLI) 3600 is provided between the virtual machine 
3500 (not shown) and the device interface layer 3700, and an abstraction device interface 3800 is provided between 
5 the device interface layer 3700 and the system software/hardware layer 3900. Otherwise, like parts are indicated with 
like reference numerals. 

[0648] The extended device layer interface (EDLI) 3600 provides a dedicated interface between the virtual machine 
3500 and the device interface layer 3700 and generally provides multithreading support to the device interface layer. 
Functions of the EDLI include routing asynchronous events to the appropriate thread in the middleware (since the 
10 device interface layer need not itself support multithreading) and routing messages between threads. 

[0649] The abstraction device interface 3800 provides a further interface between the device interface layer 3700 
and the device drivers 391 0 in the system software/hardware layer 3900. By providing such an interface, the large and 
complex device layer 3700 can be made hardware independent to a greater degree. 

15 Content management and protection system (CMPS) 

[0650] With reference to Figure 9, the content management and protection system (CMPS) 2300 mentioned above 
is distributed between the broadcast centre 1000 and the receiver/decoder 2000. The receiver/decoder component of 
the CMPS is provided in the form of a smartcard with associated smartcard reader, but in variants of the preferred 
20 embodiment is implemented solely in software or in other forms of hardware. The CMPS can ensure that only authorized 
users can record and playback content in accordance with predefined usage rules. 

[0651] An important part of the content management and protection system is the special Usage Rules Message 
(URM) which contains content management information relating to a given programme or transmission and is trans- 
mitted before such a programme or transmission. In essence, the Usage Rules Messages impose usage constraints 

25 on the playback and reproduction of the content, and can be directed only to specific portions of the content, such as 
separate 'chapters' within a programme, or to the content as a whole. Typical usage rules include restrictions on time- 
shifting, fast-forwarding, number of times a recording can be played back, and available reproduction modes. Another 
important feature, which will be described in more detail below, is that URMs relating to a given programme may be 
sent independently (from different locations and at different times) from the corresponding content or conditional access 

30 information. 

[0652] A second class of message, the CMPS Entitlement Management Message (CMPS EMM, or CMP_EMM), is 
provided to transmit access rights to the CMPS. The CMPS EMM is equivalent to the conditional access entitlement 
management message (EMM, or CAS_EMM) referred to elsewhere, but the transmitted access rights relate to the 
local storage of programme data rather than broadcast programme data, as with the 'conventional' EMM. 

35 [0653] In the preferred embodiment, shown in Figure 9, the multiplexer and scrambler 1030 receives the CMPS 
EMMs 5614 and URMs 5612, multiplexes them with the bitstream containing the unscrambled content (programme 
data) 810 and broadcasts the resulting scrambled content 800 via the broadcast system 600. The receiver/decoder 
then receives the scrambled content 800, and removes and passes the CMPS EMMs and URMs to the CMPS 2300 
and conditional access system 5000 as appropriate. 

40 [0654] The URMs are encrypted with a URM exploitation key, which in a variant of the preferred embodiment is the 
same as the ECM exploitation key. An equivalent of the URM exploitation key is maintained in the receiver/decoder 
CMPS smartcard (not shown) to allow the URMs to be decrypted. 

[0655] As mentioned above, access rights which allow a user to record and/or playback using the receiver/decoder 
are provided in the form of CMPS Entitlement Management Messages (CMPS EMM or CMP_EMM); CMPS EMMs 
45 can have the same structure as conventional EMMs, but are generally more key-oriented - a CMP_EMM typically 
embeds a key associated with a content or service. Rights to playback recorded content are granted in return for one- 
off payments (impulse purchases) or subscriptions. Various levels of access rights can also be granted in relation to 
any content, whereby a user could, for example, pay a first fee in exchange for the rights to replay content once, or 
pay a second, higher, fee in return for unlimited replays. CMP_EMMs are typically stored in the receiver/decoder CMPS 
50 smartcard, but may be stored elsewhere, such as in a conditional access smartcard, for example. 

[0656] In the preferred embodiment, rights to replay a recording can either be obtained after the recording is made 
(the 'pay-per-view' model), or prior to the recording (the 'subscription' model). In the former case, after recording the 
content, the user instructs the conditional access system that he wishes to obtain the rights to playback the content. 
If the instruction is authorised by the subscription management system, the appropriate CMPS Entitlement Manage- 
rs ment Message ("CMP_EMM") is then transmitted to the receiver/decoder via the bidirectional link. 

[0657] One of the many advantages provided by the CMPS system is that the access rights for recording and playing 
back programmes are entirely independent of the access rights for simply viewing the programmes, as in conventional 
systems. Thus, one could have the situation where one could view a programme but not record it and play it back, and 
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conversely one could be unable to view a programme, but one could record it, obtain the necessary rights and then 
play it back. 

[0658] In a variant of the preferred embodiment particularly typical of an internet distribution model, shown in Figure 
10, the scrambled content ("CONTENT*"), CMPS EMM ("CMP_EMM") and URMs ("URM") are all delivered independ- 

5 ently to a receiver/decoder 2000, from a first party 1200, second party 1202 and third party 1204. The first, second or 
third party may be, for example, a multi access portal (MAP), and the scrambled content 1300, CMPS EMMs 5614 
and URMs 5612 may be delivered. Typically, a programme provider (the second party 1 202) sends programme content 
("CONTENT") to the multiplexer/scrambler, where the scrambled content 1300 (CONTENT*) is generated and then 
transmitted to the receiver/decoder 2000 in the usual fashion. 

10 [0659] With reference to Figure 11 , the implementation of the CMPS at the receiver/decoder 2000 will now be de- 
scribed. 

[0660] A CMPS server module 2200 is provided in the receiver/decoder middleware, and comprises a CMPS server 
API, a CMPS core and a link layer. The CMPS server module 2200 interfaces with a CMPS library 3362, and interfaces 
indirectly with the HDVR controller 3350. The CM PS server module 2200 also interfaces with the MLOAD device 3438, 
15 the LCARD device 3440 (housing the conditional access smartcard), and the RCARD device 3442 (housing a CMPS 
smartcard). 

[0661] In operation, ECMs5602 received in the programme data stream are isolated by the MLOAD device and then 
routed by the CMPS link layer to the conditional access smartcard. Control words 5600 derived from the ECMs are 
then routed to the CMPS smartcard, along with corresponding URMs 5612 and CMPS EMMs 561 4 (which are preferably 
20 also received in the programme data stream, but may be received via other routes). The CMPS smartcard then com- 
bines and encrypts the three items of data to form content management messages 561 0 (CMMs) which are then passed 
to the CMPS core for further processing. In response to appropriate requests, the CMMs are then passed to the HDVR 
controller 3350 so that they can be stored on disk along with the corresponding content data. 

[0662] In the process of recording content to disk, illustrated in Figure 12, each ECM 5602 is passed to a decryption 
25 stage 5550 in the conditional access smartcard, where it is decrypted using a general exploitation key KG 5606. The 
decrypted control word 5600 then passes to an encryption stage 2202 in the CMPS smartcard, where, it is combined 
into a content management message (CMM) with the corresponding URM 5612 and CMPS EMM 5614, and then re- 
encrypted as a whole using a local exploitation key KL 5608. The CMM is then stored in a separate file 21 12 to the file 
211 0 used to store the unaltered, scrambled content in the hard disk 21 00. 
30 [0663] In the reverse process of playing back content from disk, illustrated in Figure 13, the scrambled content 1300 
is read from the file 21 1 0 on the hard disk 21 00 and fed into the descrambler 201 0. In parallel, CMMs are read from 
the separate file 2112 and fed into a decryption stage 2204 in the CMPS smartcard. The CMMs are decrypted with the 
local exploitation key 5608 and then split into the URM 5612, CMPS EMM 5614 and control word 5600. If the CMPS 
module decides that the user is entitled to view the material (on the basis of the URM and CMPS EMM), the control 
35 word 5600 is then sent to the descrambler 201 0 at the appropriate time to allow the content to be descrambled. 

INTERNAL FORMAT 

Variable bitrate bitstream transmissions 

40 

[0664] Transmissions received, processed and stored by the preferred embodiments are in the form of bitstreams, 
and the retrieval and processing of data from recorded bitstreams is dependent in part upon the characteristics of such 
bitstreams. The use of table of records, in particular HDVR and USER indices in particular embodiments, in such 
recordal and processing, particularly of files containing recordings of variable bitrate bitstreams, and the synchronisa- 
45 tion, storage and retrieval of encryption information related to such files is described later. At this point the general 
characteristics of variable bitrate bitstreams are discussed briefly. 
[0665] Figure 14 is a graph of bitrate versus time for a satellite TV transmission. 

[0666] In various embodiments, variable bitrate bitstreams similarto those illustrated in Figure 1 4 are received, trans- 
mitted and stored in or between computer devices, processors, A/D convertors, televisions, HDVRs, or storage devices 
50 for instance hard disks, tapes, computer storage devices, CDS, or DVDs. Such variable bitrate bitstreams include data 
in a variety of compression formats, including MPEG-2, MPEG-4, MP3 protected by different ciphering algorithms 
including DVB-CS, DES, 3DES, and contain video and or audio data, teletext information, subtitles, any other type of 
text information, computer data, or representations of such data. 

[0667] Figure 1 5 is an illustration of an MPEG-2 data stream as a function of time, showing schematically the position 
55 of key frames known as Intraframes (l-frames) 4500 and 4502, and delta frames in the form of B-frames, for instance 
at 451 0, and P-frames, for instance at 451 2 within the bitstream. The key frames can independently be used to regen- 
erate a portion of audio/visual data, whereas the delta frames map changes from other frames and can be used to 
regenerate a portion of audiovisual data only in dependence upon such other frames. An interframe (P-frame) maps 
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changes from the preceding frame, whereas a B-frame maps changes from either or both preceding and following 
frames. In MPEG-2 data streams, key frames are usually transmitted with a frequency of 2Hz. 
[0668] Upon reception, the bitstream is generally stored as a data file in a data storage device, unless it is played 
out or retransmitted immediately without being stored. A data file 6000, including the correspondence between time 
5 offset in a bitstream 6002 and data offset in the data file is shown in Figures 16 and 1 7. 

[0669] Further detail is now provided with respect to three general aspects of preferred embodiments:- 

• the generation and use of index tables in the retrieval and processing of stored bitstreams 

• the estimation of position in a bitstream, and the synchronisation of conditional access information with the bit- 
10 stream 

• command sets for controlling the transfer of a bitstream 

[0670] Beginning with the generation and use of index tables in the retrieval and processing of stored bitstreams, 
the structure and content of stored bitstreams, in the form of files stored by an HDVR, are first examined. 

15 

Structure of HDVR files 

[0671] Looking at the structure of stored data in more detail, HDVR files comprise both management data (referred 
to in the following as hdvr_management_data) and content data (referred to in the following as hdvr_content_data). 
20 The management data and the content data are stored at the HDVR either as separate parts of the same file, or as 
separate files. 

[0672] The hdvr_content_data comprises a stored transport stream (STS), which is discussed in more detail below. 
Firstly, however, the hdvr_management_data is examined in more detail. 

[0673] The hdvr_management_data comprises CMMs as described above (typically in the form of a dedicated two 
25 dimensional table), and typically also comprises the following tables:- 

• Index table 

• Chapter table 

• Private PMT table 

30 • Parental Control Data table 

• Maximum Values table 

• General Information table 

[0674] The Maximum Values table allows the specification of the storage structure of all of the HDVR tables, apart 
35 from the Maximum Values table itself and the General Information table. 

[0675] In preferred embodiments, the HDVR management data always comprises : 

• firstly, the General Information table 

• secondly, the Maximum Values table 

40 • thirdly, other HDVR tables, such as Private PMT tables, Chapter tables. 

[0676] For each elementary part of the hdvr_file.management_data, there is a writing function and a playing function 
which each encapsulate a jump in the file and the operation to be executed. 

[0677] Each of the above tables is described in more detail below, but firstly the structure and content of the Index 
45 table, and its use in performing operations on recorded content is examined in more detail. 

HDVR index table and operations performed by the HDVR on a recorded bitstream 

[0678] Further detail is now provided concerning the HDVR index table, comprising HDVR and USER indices, and 
50 operations performed by the HDVR on a recorded bitstream using the HDVR index table. 

[0679] The HDVR index table allows the mapping between at least one time offset (in seconds, divided into cryp- 
toperiods) in a bitstream and at least one file offset in an STS containing a representation of the bitstream. Typically, 
the bitstream is a variable bitrate bitstream, as described previously. 

[0680] The indices in the HDVR index table are separate from the CMM indices and have associated with them a 
55 CMM or cryptoperiod number, a time in seconds and a file offset number. Knowing the file offset number, the HDVR 
index table can be used to look up the file offset position with respect to a time in seconds or cryptoperiods, without 
the need for potentially time-consuming binary searching using dichotomical algorithms which falls down with a change 
in bit rate. The change in time is the time between samples. 
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[0681] Processing recorded content, for instance searching for points in a file, or a corresponding bitstream, and 
"trick mode" operations such as fast forwarding, rewinding, and skipping make use of HDVR and USER indices stored 
in the HDVR index table. Generally, the HDVR indices are inserted automatically by the HDVR, and the USER indices 
are inserted upon command of a user. 
5 [0682] In preferred embodiments, as described above, the HDVR index table is stored in the 
hdvr_file_management_data part of a HDVR file. In variants of such preferred embodiments, an HDVR index table is 
stored in a separate file, or in other locations within an HDVR file. 

[0683] As described above, various other data is stored in the hdvr_fHe_management_data part of a HDVR file in 
preferred embodiments. In particular, the conditional access information is stored as a CMM table in 
10 hdvr_file_management_data, and entries in the index table are mapped to entries in the CMM table, so that data at 
points in an HDVR file indexed by the HDVR or USER indices may be decoded using corresponding entries in the 
CMM table. 

[0684] In preferred embodiments an HDVR index table is generated by an HDVR automatically during the recording 
of a programme. Alternatively, an HDVR index table, or a further such table, is generated upon command after recordal 
15 of a programme. 

HDVR indices 

[0685] The HDVR indices are positioned at regular intervals by the HDVR and are used as play entry points in the 
20 recorded file (in the case of internal encryption). They correspond to the granularity of the play positioning. For each 
CMM family, corresponding to a recorded file or programme, each HDVR index therefore points to at least one appli- 
cable CMM ; and its position in the file is identified by a block number (file granularity). 

[0686] In the case of multiple commercial offers relating to multiple recorded content, there may be a plurality of 
CMM sets for one entry point. For instance, a user can pay for a special language version with related audio data which 
25 is stored in the STS but which is ciphered with another CMM set. Therefore, in this instance at least two CMMs would 
be required for each index entry point. 

[0687] In preferred embodiments, the HDVR indices are generated and stored in real time during the recordal of a 
programme. A recording comprises no more than MaxHdvrlndexNumber indices. 

[0688] The HDVR indices are generally positioned at periodic time offsets in the bitstream. In preferred embodiments, 
30 the bitstream comprises data compressed according to the MPEG-2 protocol and according to this protocol key frames, 
known as intraframes, are located every 0.5 seconds in the bitstream. As described above, such key frames may be 
used to regenerate a portion of audiovisual data, for instance a frame in a film, independently of other portions of data 
in the bitstream. The HDVR indices in such embodiments have time offsets which are distributed with a period of 0.5 
seconds, and the indices correspond to the beginning of each key frame. 
35 [0689] In variants of the preferred embodiments, the HDVR indices are positioned with time offsets with different 
periods, and in some variants such periods are varied both upon command of the user, and automatically by the HDVR. 

USER indices 

40 [0690] The USER indices are positioned by the client and are also play entry points. As mentioned above, the play 
granularity is the HDVR index, and in preferred embodiments the user indices are based on these HDVR indices. It is 
straightforward to recover using the HDVR indices, the CMM applicable to the USER index by CMM family. 
[0691] The USER indices are set at the time of recording of a programme or playback of a recorded programme. In 
particular embodiments the number of such USER indices is limited, and a recording comprises no more than MaxU- 

45 serlndexNumber indices. 

[0692] In preferred embodiments, the bitstream comprises MPEG-2, MPEG-4 or MP3 data, although in other em- 
bodiments the bitstream may comprises data in a variety of other compression formats. 

Bitstream operations using HDVR and USER indices 

50 

[0693] The HDVR and USER indices are used to perform a variety of operations on the STS. 
Searching 

55 [0694] For instance, as illustrated in Figure 1 8, the HDVR and USER indices are used to find preferred points in an 
HDVR file 6300, corresponding, for instance, to preferred time offsets in a corresponding bitstream. The closest point 
6310, or more usually the closest preceding point 6312, in the file to the preferred point 6314 is located in an Index 
table 6316 of HDVR and USER indices, by the HDVR, and the file is searched from this point by the HDVR to find the 
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preferred point. Generally, the searching is performed by decoding (for instance using corresponding entries in a CMM 
table) and reading data from the indexed point onward until the preferred point is found. In some variants indexed 
points correspond to preferred points, and in such variants a search is performed merely by jumping to the appropriate 
indexed point. 

5 [0695] In alternative embodiments, if a preferred point which is the subject of a search falls between points in the 
file referenced by two HDVR or USER indices, the file is searched from a point intermediate between the two indexed 
points. This intermediate point is located by linear interpolation between the two indexed points. In variants of such 
embodiments, the intermediate point is located by using other data interpolation techniques or by fitting indexed points 
to alternative functions, such as polynomial or exponential functions, or cubic spline functions. In such variants, further 

10 indexed points in addition to the two indexed points adjacent to the preferred point are used to locate the intermediate 
point. 

Trick mode operations 

15 [0696] In preferred embodiments, HDVR indices correspond to periodically spaced points in time in a bitstream. 
"Trick mode" operations, such as fast forwarding and rewinding, are performed by the HDVR, by locating, using the 
HDVR indices, decoding, and displaying data in a file corresponding to such periodically spaced points in time in a 
bitstream. 

[0697] The speed of, for instance, rewinding or fast forwarding is varied in preferred embodiments by varying the 

20 rate at wh ich the stored bitstream is played back. Typically, not all of the bitstream data is played back during a rewinding 
or fast forwarding operation, but rather selected portions, usually equally spaced in time in the bitstream, are played 
back. The rate at which data is read from the file can be varied for any particular rewinding or fast forwarding speed 
by varying the proportion of data in the bitstream which is played back. In preferred embodiments, the speed of re- 
winding or fast forwarding is varied upon command of a user. 

25 [0698] By way of example, a fast forwarding operation is illustrated in Figure 19. The HDVR locates using HDVR 
indices, decodes, and displays data at points in a file corresponding to equally spaced points in time 6400, 6404, 6408 
and 6412 in a bitstream. Points 6402, 6406, and 6410 which also correspond to HDVR indices are skipped. Invariants 
of the embodiment, the H DVR varies the speed of rewinding or fast-forwarding by varying the rate at which the selected 
points 6400, 6404, 6408, and 6412 are decoded and displayed, and by varying the points which are selected. 

30 [0699] In preferred embodiments, if the bitstream is an MPEG bitstream, the HDVR indices map to the beginning of 
key frames (l-frames in the case of MPEG-2), which can be used to regenerate portions of, in particular, audio/visual 
data independently of any other portion of data. Applying Figure 18 to these variants, the locations of key frames 
coincide with at least some of the HDVR indices' locations 6312. Fast forwarding and rewinding is performed rapidly 
by locating key frames in a file located at equally spaced time intervals or offsets in the corresponding bitstream by 

35 looking up the HDVR indices. 

[0700] In variants of the preferred embodiments, the HDVR indices, or USER indices, do not necessarily map directly 
to keyframes. As illustrated in Figure 20, indices reference time offsets 6500, 6504, 6506, 6510, 6512, 6516, 6518, 
and 6522 in the bitstream, and corresponding data offsets in a file containing a representation of the bitstream. Key 
frames are located at time offsets 6502 ; 6508, 6514, and 6520 in the bitstream (and representations of these key 

40 frames are located at corresponding data offsets in the file), but the indices do not reference these time offsets. 

[0701] Figure 20 also illustrates a fast forwarding operation in such an embodiment. The HDVR locates, using the 
indices, points in the file corresponding to points 6500, 6506, 651 2 and 651 8 in the bitstream. Points 6504, 651 0, 651 6, 
and 6522 which are also referenced by HDVR indices are skipped. Upon location of the point in the file corresponding 
to 6500, the HDVR decodes the data in the file at this point, using the appropriate CMM from the CMM table, and then 

45 proceeds to decode the following data in the file, until it locates data representing the key frame at 6502 in the bitstream. 
The key frame is then displayed by a display device linked to the HDVR. The HDVR proceeds to locate points in the 
file corresponding to 6506,6512 and 6518, and to locate data representing keyframe at 6508, 6514, and 6520. These 
key frame are displayed on the display device in sequence. 

[0702] In further variants, indices reference points in a bitstream, and corresponding points in a file, which coincide 
50 with the start of cryptoperiods. 

[0703] In a further embodiment, a representation of a bitstream is stored on a DVD with a table of indices mapping 
data offsets in the bitstream to data offsets in stored representation on the DVD. As with the HDVR embodiment, the 
indices correspond to periodically spaced points in time in the bitstream. In variants of this embodiment, USER indices 
are stored in the table of indices. The table of indices is read by a DVD player, or any device adapted to read DVDs. 

55 

Performance of trick mode operations in dependence upon hardware characteristics 

[0704] The maximum speed of operation of particular trick mode operations, such as fast forwarding or rewinding, 
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is dependent upon the maximum frame rate supported by system hardware, and is in particular dependent upon read/ 
write hard disk access time, parsing demultiplexer bandwidth, and operating system scheduling accuracy. 
[0705] In preferred embodiments, the HDVR supports any fast forwarding or rewinding speed in an allowed range, 
for instance between x1/128 and x128, despite any variation in hardware quality, by estimating the maximum frame 
5 rate allowable by particular hardware, and selecting points in the index table, and subsequently extracting frames 
corresponding to these points from the STS, in accordance with such maximum frame rate, and with the requested 
fast forwarding or rewinding speed. Typically, the maximum frame rate is determined by a read/write hard disk access 
time, a parsing demultiplexer bandwidth, or an operating system scheduling accuracy. 

[0706] So, referring back to Figure 1 9, for hardware of given characteristics able to support a particular frame rate, 
10 and for a given rewinding or fast forwarding speed, the HDVR locates using HDVR indices, decodes, and displays 
data at points in a file corresponding to equally spaced points in time 6400, 6404, 6408 and 6412 in abitstream. Points 
6402, 6406, and 641 0 which also correspond to HDVR indices are skipped. However, in a variant (not shown) in which 
the hardware can only support a lesserframe rate, only data at points 6400 and 641 2 is located, decoded and displayed, 
and data at points 6404, 6402, 6406, 6408, and 641 0 is skipped. The rewinding or fast forwarding speed is the same 
15 in both cases, as the time taken to display data between points 6400 and 641 2 in the bitstream is the same, although 
the smoothness of the rewinding or fast forwarding may be degraded in the second case. 

[0707] In preferred embodiments, a processor assesses the characteristics of the system hardware and calculates 
the maximum frame rate dynamically. In variants of such embodiments, the processor also assesses the characteristics 
of a stored bitstream in calculating the maximum frame rate allowable. 
20 [0708] Alternatively, characteristics of the system hardware, and the maximum frame rate allowable, are pre-stored 
at the HDVR. In further variants, the rate at which data is read from a file during a fast forwarding or rewinding operation 
is not varied, and in some such variants all such data is read. 

Automatic generation of index tables in dependence upon bitstream characteristics 

25 

[0709] In preferred embodiments indices, such as USER indices and HDVR indices, are created or deleted auto- 
matically in dependence upon analysis of characteristics of bitstream data by a processor. For instance, in one variant 
such a processor included in an HDVR creates indices corresponding to portions of a bitstream where the bitrate is 
within a particular range of values. Such values can be set by operation of a user-defined algorithm. 
30 [0710] By way of example, in one variant, as illustrated in Figure 21 , indices are created at points where the bitrate 
rises above a particular value 6600, set by a user. The portions of the bitstreams commencing at these points may 
correspond, for instance, to an action sequence in a film. In further variants, the processor is programmable, and the 
dependency upon analysis of characteristics of bitstream data can be varied. 

[0711] In further variants, a processor analyses user actions and creates or deletes indices, including USER indices 
35 and HDVR indices, in dependence upon this analysis. The processor is programmable and this dependency can be 
varied. In one example of such dependency, more indices are created corresponding to points in a bitstream upon 
which a user is performing a large number of actions. 

[0712] In further variants, data is inserted upon the command of the user into a table, or into an associated table or 
file, and this data is associated with particular data offsets or associated time offsets referenced by USER indices, or 
40 HDVR indices. Such data includes comments to be displayed on a screen, and commands, such as television control 
commands, and in particular includes data which activates or deactivates a parental control mechanism. Such parental 
control mechanism is generally directed to particular chapters, but in certain variants it is also directed to cryptoperiods 
and pluralities of cryptoperiods, and user defined portions of a file. In some such variants a user can select particular 
scenes within a recorded film to which they wish to control access. 

45 

Output data 

[0713] Generally, data located in an HDVR file using the HDVR and USER indices is decoded, for instance using a 
CMM table as described above, and decompressed, if it is subject to a compression protocol such as MPEG, and is 
50 output to a display device, generally a TV screen. However, in certain embodiments, such data can also be output to 
a mass storage device, or to a processor, with or without being decoded or decompressed. 

[0714] Further detail is now provided concerning the structure and generation of index tables, and the use of index 
tables in playing back encrypted content. 

[0715] HDVR and USER indices are stored together in the same table referred to as an index table, lndex_Table()., 
55 as discussed above. 

[0716] The HDVR part of the index table is a one-dimensional array of temporally periodic successive HDVR index 
descriptors. 

[0717] Each HDVR index descriptor contains the following information:- 
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• a file offset {HdvrlndexAddress[1... MaxHdvrlndexN umber]) (in numbers of blocks) in the content part, 
hdvr_file_content_data, of the HDVR file which defines the HDVR index position. The STS is divided into blocks, 
and the STS portion pointed to by the file offset corresponds to a time-date (measured from the beginning of the 
STS) that is proportional to the HDVR index position into the HDVR index descriptor array. The n th index maps to 

5 a point which corresponds to nx Hdvr_time_stamp seconds having passed since the start of the STS; 

• an array of CMM family indices (HdvrlndexCMM[ 1... MaxHdvrlndexNumber] [1 ... ComponentNumber]) that define 
which CMM descriptors (CMM_ld) are required to decipher the portion of the STS pointed to by the particular 
HDVR index. For each of the ComponentNumber components (video, audio, teletext) a reference to the CMM_id 
of the corresponding CMM_table is given for each index, facilitating trick modes during subsequent reading; 

10 • the chapter identifier to which the HDVR index belongs; and 

• the private PMT identifier (HdvrlndexPMTVersion[1 ... MaxHdvrlndexNumber) that is used to demultiplex correctly 
the STS portion pointed to by the HDVR index. 

[0718] The USER index part of the index table, of maximum size MaxUserlndexNumber, is a one-dimensional array 
15 of USER index descriptors. Note that USER indices are not sorted by time. Each USER Index (Userlndex[1 ...MaxU- 
serlndexNumber) is, as a matter of fact, a reference to a particular HDVR index, which corresponds to a particular STS 
play entry point. Each USER index contains the following information :- 

• a status that defines whether the USER index is either enabled or disabled; and 

20 • the HDVR index reference (Hdvrlndex_ld) corresponding to the time-date that a user wanted to bookmark (taking 
the origin as the beginning of the STS). Note that this information is relevant when the relevant status is enabled. 

Creation of Index tables 

25 [0719] The index table is constructed in two stages:- 

• the HDVR Index table is calculated by the hdvr_recorder upon recording of a file 

• the User Index table is empty afterthe first recording; it is only during reading a command is sent to the hdvr_player 
to insert the User Index. 

30 

Creation of an Hdvr Index table by hdvr_recorder 

[0720] The Hdvr Index table is calculated and updated upon each reading of the disc: 

35 • the principle of calculation of the index points, HdvrlndexAddress[n], is based upon a linear interpolation between 
two readings of index position, as illustrated in Figure 22. 

• The corresponding CMMs, ComponentNumber CMM_ld, are themselves calculated at the end of each reading. 
In scrutinising each CMM_table, one compares the position. Hdvrlndex Address, of the current index with the po- 

40 sition, in BlockNumbers, of the last CMM, identified by CMMJd, of each table. Two cases are possible:- 

• either, HdvrlndexAddress > BlockNumber[CMM_number] f which signifies that the index is actually that of the 
last CMM, in which case HdvrlndexCMM=CMM_number 

45 • or, there exists a CMMJd in the CMM_table such that BlockNumber[CMM_id] < HdvrlndexAddress < Block- 

Number[CMM_ld+1], in which case HdvrlndexCMM=CMM_ld Note that the size of the file being a monoton- 
ically increasing function, the interpolation of an index will always give a position behind the writing pointer at 
all times. 

50 • HdvrlndexPMTVersion is a counter which increments its value each time the PMT table is modified. This number 
refers to a structure that links together all the information linking PIDs/Components. The value is updated for each 
index. 

Creation of the User Index table by the hdvr_player 

55 

[0721] The User Index table is filled upon reading of the file. The user sends an insertion of index command, via an 
Application, and it falls to the HDVR to place appropriately the associated index point, Userlndex. In taking into account 
the User to Application to HDVR reaction times, one can simplify the positioning of the index by deciding to calculate 
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it from an entry in the Hdvr Index sub-\ab\e; this is justified when the time spacing of index points (HdvrlndexTimeStamp) 
is sufficiently small (Is or 1 .5s). Hdvr rounds the time/date of the sending of the insertion of the index to the closest 
multiple of HdvrlndexTimeStamp and then fills the Userlndex field indicating the identity of the corresponding Hdvr 
index point, Hdvrlndex_ld. 

5 

Use of index tables 

[0722] The role of the index table is to provide entry points for reading of a file, HdvrlndexAddress, as well as infor- 
mation relative to the local decryption, HdvrlndexCMM. 
10 [0723] Two methods exist: 

• use of the index table alone 

• use jointly of the index table and sections inserted during recording, ie: Evt_CAS_Ecm(1 ...ComponentNumber) as 
discussed in more detail later. 

15 

Use of index tables alone 

[0724] The use of the index table alone upon reading of a file is very simple to implement. This mode of operation 
is obligatory in Trick-mode; fast forwarding necessitating jumps in the file, or rewinding. In addition, it may be advan- 
ce tageous to test its performance in normal reading mode of speed x 1 . 

[0725] To give an example of use, take the following scenario using a file of 15 minutes in length, with 900 Indices, 
one per second. A command is sent to read forward at speed x 1 from the 5 th minute. The following functions are then 
performed by the HDVR:- 

25 • search for the 300 th index, Hdvrlndex in hfmd 

• read the address stored at that index, HdvrlndexAddress[300], and updates the current position, cur_pos 

• read the CMM corresponding to that index point, HdvrlndexCMM[300][1 ... ComponentNumber], and update the 
current CMM, cur_CMM[1 ...ComponentNumber] 

• optionally, construct or update the table in anticipation of loading the subtable HdvrlndexCmm[300-n...300+n][1 ... 
30 ComponentNumber] 

[0726] HDVRJJSER then sends the identifier of the current CMM, cur_CMM[], to the CMPS, recovers the control 
word and descrambles the components. 

[0727] There follows a request to read forward in the file, HdvrlndexAddress[301]-HdvrlndexAddress[300] blocks 
35 which correspond to a reading of 1 second. 

[0728] At the time of receipt of Evt_Write_Fifo_Completed f the preceding commands are repeated for the 301 st 
Hdvrlndex. 

[0729] The advantage of this solution resides in the synchronisation of the descrambling processes, and of navigation 
in the index table; there are no asynchronous modifications of the CWs. 
40 [0730] The principal pitfall is the double anticipation of the CMM positions by this operation: 

• a first overestimation, upon recording, of maximum duration cryptoperiod/security_coefficient seconds in the per- 
manent regime, and of cryptoperiod seconds in the critical transitory regime. 

45 • a second overestimation, upon reading, of a maximum duration of HdvrlndexTimeStamp s. 

[0731] Knowing that a CMM applies to 2 cryptoperiods, this last approximation of approximately one second should 
not perturb the descrambling of the data in reading mode of speed x 1 . All the more since in Trick-Mode, this solution 
becomes unworkable. 

50 

Use jointly of index tables and sections inserted upon recording 

[0732] Upon the recording of a file, for each cryptoperiod and for each component, there is inserted a section that 
can be filtered by the Mload device upon reading, allowing one to obtain information concerning the change in CWs 
55 in the STS, as well as that contained in the hfmd. 

[0733] Unfortunately, because of the approximation of the CMM positions in CMM_table upon recording, there is a 
variable discrepancy between the CMM information of the STS stream, Evt_CAS_Ecm(1... ComponentNumber), and 
the information contained in the hfmd, HdvrlndexCMM[1 ...HdvrlndexNumber][1 ...ComponentNumber]. To understand 
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this discrepancy, consider the n th transition from CW(n-) to CW(n), as illustrated in Figure 23. 
[0734] Performing a reading using the inserted section to change the cur_CMM. 
[0735] From the index i: 

5 • update cur_CMM, ie HdvrlndexCMM[i]=CMM_ld(n) 

• read up to index i+1 

• no section between i and i+1 

10 

• comparison between cur_CMM and HdvrlndexCMM[i+1] 

• same value 

15 • read up to index i+2 

1/ change of CW at the level of the STS 

2/ the Mloadon the section inserted beforehand generates an Evt_Top_Ecm 
3/ incrementation of cur_CMM, which becomes CMM_ld(n+1) 

20 

• comparison between cur_CMM=CMM_ld(n+1) and HdvrlndexCmm[i+2]=CMM_ld(n) 

• Attention, the value in hfmd is retarded by one index. 
25 • read up to index i+3 

• no section between i+2 and i+3 

• comparison between cur_CMM=CMM_ld(n+1) and HdvrlndexCMM[i+3]=CMM_ld(n+1) 

30 

• same value 

• the retardal of the index is made good 

[0736] The reading occasionally produces a retardal of indices, but this problem can be compensated for. 
35 [0737] Conversely, if the Application requests a reading from index i+2, the result of the combined use of sections 
and the index table can prove to be disastrous: 

• update cur_CMM, ie HdvrlndexCMM[i+2]=CMM_ld(n) 

• read up to index i+3 

40 

• no section between i+2 and i+3 

• Comparison between cur_CMM_ld(n) and HdvrlndexCMM[i+3]=CMM_Id(n+1 ) Strangely, the value in hfmd is to 
an index in advance. One has therefore missed the inserted section. 

45 

[0738] Two cases present themselves: 

• one has confidence in cur_CMM, and one keeps a retarded Ecm (dangerous) 

• one has confidence in HdvrlndexCMM[i+3], and in this case what is the use of the inserted section 

50 

[0739] To conclude, the use of inserted sections during playback of a recorded file can be problematic because the 
positions in the file are produced via hfmd for which the positions, in blocks, are overestimated. It is therefore dangerous 
and a source of error to put together two types of incompatible synchronisation information: 

55 • information of position in hfmd (in Hdvrfndex or CMM_Table) 

• sections inserted in the STS 

[0740] It would be more coherent to choose definitively a unique synchronisation basis for the index table for which 
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the fineness of the synchronisation will be sufficient if: 

• the process of estimation of the Ecm positions is valid (hybrid filter, as discussed in more detail below) 

• the HdvrlndexTimeStamp is sufficiently small for the precision of the CW transitions (ie <Cryptoperiod=Ecm re- 
5 coverytime). 

[0741] More detailed discussion of the synchronisation of CMMs, and estimation of bitstream positions is provided 
below. 

10 Structure of HDVR files 

[0742] Returning to discussion of the structure of HDVR files, as discussed above they comprise management data 
(for example hdvr_file.management_data) and content data (for example, hdvr_file.content_data). 
[0743] In preferred embodiments, the hdvr_file_management_data() is contained in the n first clusters allocated to 
15 the HDVR file and the hdvr_File_content_data() starts with the following cluster. 

[0744] In order to simplify the access to the file, there is a first file descriptor for the management data and a second 
file descriptor for the stored transport stream (STS). 

Other tables included in the management portion of HDVR files 

20 

[0745] The various tables which make up the hdvr_file_management_data(), and which were listed above, are now 
described in more detail. 

CMM table 

25 

[0746] CMM information provided by the CMPS is stored by the HDVR Server in a dedicated two dimensional table. 
Each element of the CMM table is stored according to two coordinates:- 

firstly, the CMM table identifier, which refers to the particular CMM family the CMM descriptor belongs to ; and 
30 secondly, the CMM identifier, which refers to the particular CMM index of the CMM descriptor in the particular CMM 

family. 

[0747] Each element of the CMM table is classed as a CMM descriptor and contains the following information : 

35 • a file offset in blocks of the CMM position related to HDVR file content data that allows the HDVR to decipher the 
STS from this CMM file offset to the next one 

• the first HDVR Index to reference this particular CMM (this is a cross reference between the HDVR index table 
andtheCMM's) 

• CMM structure as defined by the CMPS 

40 

Chapter table 

[0748] The chapter notion is similar to that of DVDs. In particular embodiments, a recording always contains at least 
one chapter. Chapters are also play entry points and the chapters are linked to the HDVR indices. The chapter beginning 
45 markers, as well as their characteristics (see below) are transported by the CMMs provided by the CMPS at the time 
of the recording phase. A recording comprises a maximum number of MaxChapterNumber chapters. 
[0749] The chapters are stored together in a single table referred to as Chapter_Table() which contains a maximum 
number of chapters, MaxChapterNumber. 
[0750] Chapter information arises from two distinct sources:- 

50 

• firstly, from the HDVR chapter table; 

• secondly, chapter information is provided during recording from a broadcaster and encapsulated into a special 
CMM that holds what the HDVR defines as the CMM chapter control. In further variants this CMM chapter control 
holds viewing rights in a similar fashion to existing MPPV. 

55 

[0751] In order to group into the same structure all information related to a chapter descriptor, a reference to the 

special CMM is inserted into each chapter descriptor as the CMM chapter control's coordinates. 

[0752] The chapter table is a one-dimensional array of HDVR chapter descriptors. Each chapter descriptor contains 
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the following information :- 

• the HDVR index reference (Hdvrlndex_ld) corresponding to the time-date that is bookmarked by the chapter (taking 
the origin as the beginning of the STS); 

5 • the chapter duration; 

• a trickmode bitmap that specifies for each trickmode, such as pause, fast-forward, fast-rewind and so on, whether 
the particular trickmode is enabled or disabled. This trickmode is suitable for the whole chapter; 

• a control viewing word that is compared with the parental control data structure according to a particular HDVR 
algorithm and defines whether the chapter is viewable or not ; for example, according to a user's PIN code and 

10 the moral content of the current chapter. 

• special CMM coordinates (the so-called CMM chapter control, as discussed above) 

Private PMT table 

[0753] The Private PMT (programme map table) is a PMT belonging to the HDVR which takes an inventory of the 
information necessary for the exploitation of the components of the recorded or soon-to-be recorded service. It com- 
prises two pseudo tables, one of which is provided by the client (who knows about the nature of the components), and 
the other of which is provided by the CM PS (which knows the active conditional access (CA) PI D for each component). 
[0754] During the recording, the recorded service plan can be modified; there can therefore be one or more private 
PMTs applicable to the recording. One MPEG section inserted into the STS marks each development of the recorded 
service plan. Furthermore, the HDVR inserts up to three other MPEG sections in the recorded bitstream. 
[0755] The number of applicable private PMTs is limited to MaxPrivatePMTN umber. 

[0756] They are grouped together in a table referred to as Private_Pmt_Table() which takes inventory of a maximum 
private PMTs MaxPrivatePmtNumber, which each take an inventory of components MaxComponentNumber. 
[0757] A Private PMT table is a one-dimensional array of private PMT descriptors. The HDVR private PMT descriptor 
is an HDVR-defined embodiment of a common MPEG-2 defined PMT (see ISO/IEC 13818 for further information). 
[0758] The following information is added / removed to an ISO like PMT to create an HDVR private PMT- 

• HDVR uses PID information. Indeed the HDVR inserts some of its own PID into the original TS to obtain an STS 

• PID information relating to unrecorded components is removed from the original TS to obtain an STS. For each 
component, CA_PID information (CA standing for Conditional Access in this context) is removed as the CA aspect 
is managed by the CMPS and the HDVR does not deal directly with the CA content 

• for each component some CMM information is added to allow the HDVR to playback encrypted STS. So the CMM 
family which the component depends upon is specified. 

• for HDVR internal use, the CMM family to which the CMM chapter control belongs is specified 

• a file offset in blocks of the private PMT descriptor position related to the HDVR file content data for which the 
present private PMT descriptor is suitable 

• the HDVR index reference corresponding to the time-date whose origin is the beginning of STS, from which the 
present private PMT descriptor is suitable 

Rights and the Parental Control Data Table 

[0759] The rights group together the information relating to the authorisations associated with the playing of a pro- 
gramme and are all supplied once the programme is recorded. 
45 [0760] This information is stored together in a single table referred to as Parental_Control_Data(). 

[0761] The Parental Control Data structure provides viewing rights control with a chapter granularity. It is used by 
the HDVR server to allow or forbid access to a chapter section or the whole file according to two different processes:- 

• a comparison between a parental control data PIN code and the user's own PIN code level with an external control 
50 such as a PVR control (where PVR stands for Personal Video Recorder, the high level end-user API of video 

recording functionality). The access control is suitable for the whole HDVR track file. 

• a comparison between a particular parental control table that associates a parental chapter control word for each 
chapter of the HDVR chapter table. In particular embodiments, it enables or disables the viewing control mecha- 

55 nism. If viewing control is enable for a particular chapter, then the HDVR server compares the global parental 

viewing control word with the related chapter viewing control word and fixes the HDVR automaton player state 
according to an internal HDVR algorithm, such as forcing the automaton to a pause mode before the chapter 
concerned begins. 
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[0762] In certain embodiments the HDVR provides free read/write access to the parental control data and in such 
embodiments, the HDVR cannot be responsible for the efficiency of the parental control mechanism. 

Maximum values table 

[0763] In order to make the management data structure dynamic, the maximum sizes of each of the tables are 
provided in the header of the HDVR file. This table is referred to as Max_Values(). 

[0764] The role of Maximum Values is to assume the dynamic structure of HDVR file management data. So for each 
HDVR structure declared above, except the general information basic structure, the Maximum Values structure spec- 
ifies its offset and length into the HDVR file management data. This provides an easy mechanism to extend the internal 
format without any compatibility problems. So, for example, an old HDVR server is able to read newer HDVR file tracks 
in the case of HDVR file tracks exported between two different STBs via a firewire bus. 

Generalities and the General Information table 

[0765] The generalities group together the general information on the recorded programme. They are stored in a 
table referred to as General_lnformation(). 

[0766] General information contains the followings at a sight information :- 

• a CMPS private information so called CMPS file identifier. Note that this information is CMPS read only mode and 
do not pass through the HDVR server API 

• the HDVR Server version number which creates the current HDVR file track 

• the delta time elapsed from one HDVR index to the next one. It can be also viewed as the HDVR index time 
sampling period 

• the HDVR file track's total duration 

• the total STS size in blocks 

• the current allowed time-shifting depth. Note that a null value is considered as an infinite time-shifting depth, for 
example in the common case of file recording. 

• the definition of a client private zone given by its HDVR file management data offset and its length. Note that HDVR 
Server API does not provide any read/write access to this dedicated zone. Client zone input/output operation is 
on client's charge. 

• the recording mode from the different following allowed states :- 

• immediate mode for an user instant recording 

• push mode for a broadcaster's special use, for example to upload commercial offers 

• programmed mode for a one-shot differentiated recording 

• periodic programmed mode for a periodic differentiated recording 

• time shifting mode. 

• the HDVR Player Server identifier if there is currently an HDVR Server playing the HDVR file track, in order to 
avoid concurrent file access 

• the HDVR Recorder Server identifier if there is currently an HDVR Server recording the HDVR file track, in order 
to avoid concurrent file access. 

Storage of HDVR management data 

[0767] For the hdvr_file.management_data, the CM M Table (CmmTab) is a large table (several Megabytes) and filling 
it depends on the broadcast characteristics and the duration of the recorded programme. In order to avoid the CmmTab 
occupying space unnecessarily on the disk, the table is not created on the disk with the maximum value (CmmMax- 
Number), but gradually during the recording. On the other hand, the offsets for achieving the different CmmTabs (in 
the case of internal encryption) take into account the CmmMaxNumber value. 

[0768] With reference to Figure 24, one therefore obtains on the disk an hdvr_file.management_data made up of 
holes. 

[0769] Figure 24 illustrates a special functionality of the GFS library that allows a file to have a virtual size superior 
to its effective disk allocation size. For example, HDVR File management data has a virtual size that can provide 
complete management for a total HDVR track duration of 20 hours. However, generally, the HDVR track is only 2 or 3 
hours long. According to the GFS library holed-file feature, the virtual size of HDVR file management data is not entirely 
allocated : some unallocated clusters are present into the hdvr_file.management_data offset range. 
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HDVR content data - Stored Transport Stream 

[0770] Leaving discussion of the management data stored by the HDVR and returning to discussion of the structure 
of the stored content, the STS (stored transport stream) is now described in more detail. 
5 [0771] The STS is the name given to the bitstream recorded by the HDVR and is made up of the following data:- 

• reproducible data of the service to be recorded (client's choice) 

• one or more sets of video data 

• one or more sets of audio data 
10 • one or more sets of subtitles 

• teletext information 

• data inserted by the HDVR 

[0772] The data inserted by the HDVR is in the form of MPEG sections and is referred to as 
15 HDVR_<section_name>_SECTION elsewhere. 

[0773] The HDVR_NEW_PMT_SECTION is inserted in order to mark each recorded service plan change. 

[0774] There is a maximum of MaxPrivatePmtNumber-1 HDVR_NEW_PMT_SECTION sections in the STS. 

[0775] The HDVR_TIME_TAG_SECTI ON section is periodically inserted in order to provide an indication of the time 

that has passed during the playing of the STS. This section is optional. 
20 [0776] The HDVR_CAS_ECM_SECTION section is only used in the case of internal encryption of the reproducible 

data (DVB-CS) and is inserted to mark the beginnings of the cryptoperiods. 

[0777] The HDVR_CAS_ECM_SECTION allows, during the playing of an STS, the signalling of a change of CW for 
the associated reproducible components and to apply therefore a new pair in the descrambler. 
[0778] There are as many different types of HDVR_CAS_ECM_SECTION sections which distinct ECM PIDsforthe 
25 recording service. An HDVR_CAS_ECM_SECTION section type is therefore associated with each CMM family. 

Recordal of data 

[0779] Finally, some further details are provided concerning the process of recordal of content by the HDVR and the 
30 cases of internal and external encryption are examined. 

[0780] Figure 25 illustrates the flow of data between the HDVR controller and the mass storage device. The data 
going to and coming from the Mass Storage Device is transmitted via FIFO (first in first out) memories, which may be 
of different sizes. 

[0781] A recording comprises a maximum of MaxCmmNumber CMM. The returned CMM contains an encrypted part 
35 and another clear part and only the latter is directly exploitable by the HDVR: it provides the navigation and restriction 
constraints for the STS part associated with the CMM. 

[0782] Since the granularity of the file is a block, a CMM applies itself to a collection of consecutive blocks. The start 
point of the application of a CMM in the STS is identified by a block number. 

40 Internal encryption 

[0783] For internal encryption, the reproducible data, upon leaving the demultiplexer 230, remains encrypted and is 
recorded without modification and the decryption of the reproducible data is then done at the time of playing. The 
decryption keys are broadcast using the ECM transported on one or several ECM PIDs and are valid for one cryptope- 
45 riod. The changing of the cryptoperiod is signalled within the broadcast. The decrypting keys are recovered at each 
new cryptoperiod by the HDVR server by using the services of the CMPS server. 

[0784] For internal encryption, there are as many CMMs as there are cryptoperiods for the duration of the recording 
within the MaxCmmNumber limit: the encryption is said to be temporal. 

[0785] Each CMM transports, among other things, a pair of keys (referred to as CW: control words) which allow the 
50 decrypting during playing, for one cryptoperiod, of one or several reproducible components. The CWs are found in the 
encrypted zone of the CMM and are not directly exploitable by the HDVR: it is necessary to ask the CMPS for an 
exploitable CW. 

[0786] For this type of encryption, there can be ECMs as a service which can be applied to one or several or even 
all of the reproducible components. Consequently the CMMs are grouped together by CMM family and this number 
55 is determined by the number of ECM P ID families - that is, the number of distinct ECM PIDs referred to in the programme 
map table (PMT). To each of these families, there are associated dependent encrypted components, for example: 

ECM PID X broadcasts key pairs for the reproducible video component. 
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ECM PID X broadcasts the key pairs for the reproducible audio component. 
ECM PID Y broadcasts the key pairs for the reproducible teletext component. 
ECM PID Z broadcasts the key pairs for the reproducible subtitle component. 

5 [0787] For this example, there are three CMM families. A correspondence table defines the associations between 
the reproducible data and the CMM families. In the case of a change in the service plan, a new correspondence table 
will be defined: for a new ECM PID, a new CMM family will be created. For this encryption, the number of possible 
CMM families will be equal to the number of reproducible components that can be recorded with the HDVR server. 

10 External encryption 

[0788] For external encryption, the reproducible data, upon leaving the demultiplexer 230 is in the clear and the 
encryption of this data is done at the time of writing on the disc and the decryption is done at the time of playing. The 
decrypting keys to be applied are determined by the CM PS and recovered by the HDVR server by using the services 
15 of the CM PS server. 

[0789] For external encryption, there can be as many CMMs as there are keys applicable to the recording within the 
MaxCmmNumber limit. The allocation of these CMMs on the recording is the responsibility of the HDVR: the encryption 
is said to be spatial. 

[0790] Each CMM transports the key (hereinafter referred to as CK) which allows the encryption and decryption of 
20 all the reproducible components of the recording service. The CK is found in the encrypted zone of the CMM and is 
not directly exploitable by the HDVR: it would be necessary to ask the CM PS for an exploitable key. 
[0791] For this type of encryption, there is always only one CMM family. 

[0792] A CMM family is grouped together in a table called Cmm_Table() which contains a maximum of MaxCm- 
mNumber CMMs. 

25 [0793] The bit stream recording and playback procedure will now be described in more detail. The recording proce- 
dure involves the estimation of positions in the bit stream with which control words will be synchronised for the later 
playback process. The estimation is required in order to allow this recording technique to afford the advantages of 
security and minimal processing and storage. 

[0794] Turning to a second general aspect of preferred embodiments, the estimation of position in a bitstream and 
30 the synchronisation of conditional access information with the bitstream are now described in more detail. 

CMM SYNCHRONISATION 

Bit stream synchronisation 

35 

[0795] Before discussing some problems associated with recording scrambled bit streams and their solutions, the 
structure of such bit streams will now be described with reference to Figure 26. 

[0796] In Figure 26 a scrambled MPEG bit stream 1300 (such as that received at the receiver/decoder from a broad- 
cast centre) is illustrated. The bit stream as shown is divided into successive cryptoperiods 8000, 8002, 8004, each 
40 scrambled with a corresponding control word. The bit stream 1300 also contains Encrypted Entitlement Control Mes- 
sages (ECMs) 8010, 8012, 8014. 

[0797] To provide the system with some redundancy (and therefore fault-tolerance), each ECM in fact contains two 
control words: one for the present cryptoperiod, and one for the following cryptoperiod. Thus ECM 801 0 contains the 
control words to descramble both cryptoperiod CP7 8000 and CP8 8002. Similarly, ECM 8012 contains the controls 
45 words necessary to descramble both cryptoperiod CP8 8002 and CP9 8004. In fact, the ECMs are periodically retrans- 
mitted to ensure the continued smooth operation of the system in the event of the user changing channel ('zapping') 
or a temporary fault preventing reception of the first set of ECMs. For simplicity, only the first ECM in each such series 
is shown. 

[0798] The conditional access smartcard 5500 typically takes several seconds to decrypt each ECM, but each cryp- 
to toperiod is relatively long (1 0 seconds in the preferred embodiment), so there is not generally a problem with timing in 
the case of receiving and decoding live content (such as that received via satellite from a broadcast centre). 
[0799] In the case of recording an audio/visual bit stream (such as a received digital television broadcast) to hard 
disk and the subsequent playback, timing can be more of a problem, since, in general, conditional access data relating 
to a recording will have to be manipulated before, during or after storage in order to overcome the time-limitation of 
55 the recording (in other words, remove the dependence on the time-varying global encryption key K G used to encrypt 
the incoming ECMs). 

[0800] It has been found advantageous to synchronise the scrambled content 800 (in the form of an audio/visual bit 
stream) with the relevant ECMs, so that the control words 5600 can be fed into the descrambler at the correct time to 
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allow the content 800 to be descrambled. More precisely, it has been found useful to synchronise the audio/visual bit 
stream and conditional access data (preferably, as noted above, in the form of the original ECMs) at the time of storing 
the audio/visual bit stream and conditional access data. 

[0801] The synchronisation process is performed by the HDVR 3850 in preferred embodiments. Alternatively, the 

5 synchronisation process is performed by the CM PS system 2300. 

[0802] During the synchronisation process, a reference is made between the conditional access data and a corre- 
sponding position in the bit stream. Typically, this reference takes the form of two pieces of data: the identifier of a 
CMM corresponding to the conditional access data (ECM) and the corresponding file write pointer (FWP) in the bit 
stream. In the preferred embodiment, such a reference is stored in a table in the previously- mentioned management 

10 data portion 2112 of the file also containing the stored bit stream, so that it can be easily accessed during playback. 
[0803] The synchronisation can be brought about by evaluating the position of each ECM as it arrives, storing such 
positions, and reloading the stored positions during playback as the basis for timing when the control words should be 
delivered to the descrambler. The evaluation of such positions exactly to the nearest bit or byte in the bit stream can 
occasionally be inefficient. 

15 [0804] Some issues concerning the exact determination of the position of an ECM in a stored bit stream will now be 
considered in the context of the present system, where the bit stream is fed from a demultiplexer into a rem ultip lexer 
then into storage in a hard disk via a FIFO. 

[0805] Data, such as ECMs, is extracted from the output of the demultiplexer by the MLOAD device, operating semi- 
autonomously of the upper software layers in which the control of the synchronisation process is more easily managed. 

20 Due to interrupt latency and other similar considerations, the receipt of the ECM from the MLOAD device cannot be 
precisely timed. Furthermore, receipt of the ECM is usually only acknowledged by a EVT_CAS_ECM event 8400 (not 
shown) generated by the conditional access smartcard after certain checks have been made (including a check as to 
whether or not the ECM is 'new 1 or merely a retransmission). This event will lag the actual receipt of the ECM itself by 
a time offset, herein referred to as At, and the amount of data corresponding to At will vary, depending on the prevailing 

25 bit rate of the bit stream. The subject of At will be returned to later. 

[0806] One issue to consider is that the FIFO buffer has a dynamically adjustable size, and may vary between empty 
and full depending on unpredictable factors. A further issue - returned to later - is that in accordance with the abstracted 
architecture of the receiver/decoder, data is stored to the hard disk in indivisible segments such thatthefile write pointer 
(FWP) is only determinable before and after the writing of each segment (of perhaps, 2 Megabytes of data at a time); 

30 the 'current' FWP cannot be read at any arbitrary time (when, for example, an EVT_CAS_ECM arrives). 

[0807] The net result is that an exact determination of the ECM position can require additional analysis of the bit 
stream as it arrives and/or an intimate knowledge of the state of various buffers and file pointers in the system (which 
can be relatively inefficient). 

35 Estimation of positions in the bit stream 

[0808] As explained briefly above, each ECM relates to a particular 1 0 second cryptoperiod and also contains the 
control word for the next cryptoperiod, which offers some scope for a different solution for evaluating the position of 
the ECM, namely estimation (rather than determination) of the position. 

40 [0809] Various means have been found of estimating the position, and some of these will be described later. One of 
the more efficient means involves manipulating the bit stream in such a way that the worst-case estimate - relatively 
quickly computed - will always yield a 'safe' answer, and can always be used in preference to more involved estimation 
methods. By 'safe', it is implied that, during the reconstruction of the stored bit stream using the above estimated 
positions to control the timing, the control words will each be delivered to the descrambler during the appropriate two 

45 cryptoperiod time-window, and the descrambling operation will thus operate correctly. If, by contrast, a control word is 
delivered during the wrong cryptoperiod, the descrambler will fail to descramble the stored bit stream, resulting in a 
loss of picture and/or sound for the user. 

[0810] This above-mentioned means for estimating the position of the conditional access data (or any other appro- 
priate data, for that matter, such as particular subtitle, audio, video, application or other data) in the bit stream will now 

so be described with reference to Figure 27. 

[0811] In Figure 27, the segments S21 , S22, S23 and so on are shown in relation to the bit stream (which is shown 
having a data offset scale - due to varying bit rates, as discussed later, the segment sizes would be distorted and 
uneven if a time scale were used). Also shown is the equivalent file write pointer (FWP) values, and the prevailing 
cryptoperiods CP12, CP13, CP14. The actual position of an ECM 5602 in the bit stream is shown, as is the 

55 EVT_CAS_ECM event 8400 which occurs at a time At later. The boundaries of the segment are shown as dashed lines 
either side of the ECM 5602 and EVT_CAS_ECM event 8400. Lastly, the corresponding estimated position of the ECM 
(FWPest) is shown to the right of the end of the segment containing the ECM 5602. 

[0812] The end of a particular segment (and therefore the beginning of the next segment) is signalled to the CMPS 
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system (which is largely responsible for the estimation in certain embodiments) near-instantaneously by the reception 
of an EVT_FIFO_WRITE_COMPLETED event, generated by the mass storage device to indicate that the current 
segment write operation has completed. At this point, the current FWP can be assumed to be equal to the previous 
FWP plus the segment size just used. 

5 [0813] In the preferred embodiment, the HDVR, rather than the CMPS, estimates the position using the 
EVT_CAS_CMM event, derived from the EVT_CAS_ECM event, which is sent shortly afterthe EVT_CAS_ECM event 
is received by the CMPS. Accordingly, the estimate is not based directly on the EVT_CAS_ECM event. In fact, in many 
practical situations the time delay between the EVT_CAS_ECM event and the corresponding E VT_C AS_CM M event 
is relatively small and can be ignored. 

10 [0814] The estimation comprises determining the segment in which the ECT_CAS_ECM event 8400 falls (since the 
reception of the ECM 5602 is not itself globally notified, not least because most received ECMs are mere retransmis- 
sions which are then subsequently discarded by the conditional access system), and then taking the estimate of the 
position according to the following formula: 

15 

FWP est = £(X|Li s ^e_ segment(i) + size fifo^ + k 

20 

- where E( ) is an expectation operator size_segment(n) is the size of each segment (in the present illustration, 
size_segment(22) = 2 Mb, for example, and the sum of all previous segment sizes is 30 Mb), size_fifo is the amount 
of data in the FIFO (which, as noted, can vary), and k is a "security parameter" (typically between 0 and 1 Mb) which 
adjusts for further latencies and timing problems in the system so as to ensure the estimate is an overestimate (see 
25 below). 

[0815] The expectation term E( ) in the above equation addresses the fact that the size_fifo parameter at least cannot 
be determined exactly. Typically, for a given maximum allocated FIFO size fs (say), E(size_fifo) is taken as >s> fs (which, 
in the above example implies a maximum FIFO size of 0.2 Mb). As will be described in more detail later, the choice of 
size_segment can be fine-tuned to keep the resulting estimate 'safe' yet efficient. 
30 [0816] In the example given in Figure 27, E(fifo_size) is taken as 0.5 Mb, k is equal to 0, and the Zsize_segment(i) 
term is equal to 32 Mb, yielding a FWPest of 32.5 Mb when the above formula is applied. 

[081 7] Underlying the above formula is the realisation that, because of the double control word redundancy of ECMs, 
it does not matter if the estimated position of the ECM falls within the cryptoperiod immediately after that with which it 
is associated. The estimation will fail, however, if the estimated position falls within cryptoperiods beyond that, or in 

35 the cryptoperiod immediately preceding the correct cryptoperiod. 

[0818] In Figure 27, for example, during the writing of segment S22, it is impossible to distinguish between 
EVT_CAS_ECM events 8400 caused by ECMs sent in respect of cryptoperiod CP1 2 and EVT_CAS_ECM events 8400 
caused by ECMs sent in respect of cryptoperiod CP1 3. Since to incorrectly label a CP1 2 ECM as a CP1 3 ECM is not 
critical, and incorrectly labelling a CP13 ECM as a CP12 ECM is fatal, the need for an overestimate can therefore be 

40 appreciated. 

[081 9] It should also be considered that the maximum segment size can not exceed the size as a cryptoperiod (less 
the size of the FIFO size parameter), since with larger segment sizes there exists the possibility of receiving two 
EVT_CAS_ECM events 8400 within the same segment write operation, and two sets of control words. This too is fatal, 
since, owing to various system constraints described above (and others, including the asynchronous nature of inter- 
ns device communication), there is ambiguity about the order in which the corresponding ECMs were received, which can 
lead to the wrong control words being applied to the wrong cryptoperiods. 

[0820] Bearing the above in mind, the robustness of the estimation routine in extreme cases will now be illustrated 
further with respect to Figures 28 and 29. 

[0821] In Figure 28, an incoming ECM 5602, resulting EVT_CAS_ECM 8400 and estimated position of the ECM 
so (FWPest) are shown . This represents one extreme case where the EVT_CAS_ECM event 8400 is received just before 
the EVT_FIFO_WRITE_ COMPLETED event, at the end of the segment S22. The resulting estimate (32.5 Mb, in fact) 
here is at its closest to the ECM 5602 (at a distance of 0.5 Mb plus the data size equivalent to At), and in this case falls 
within the correct cryptoperiod (CP1 3). 

[0822] In Figure 29, the ECM 5602 and resulting EVT_CAS_ECM 8400 are shown fractionally further forward in the 
55 bit stream, with the EVT_CAS_ECM 8400 occurring within the next segment S23. The resulting estimate (34.5 Mb, in 
fact) here is at its furthest from the ECM 5602 (at a distance of 2.5 Mb plus the data size equivalent to At), and falls 
within the cryptoperiod (CP14) afterthe correct cryptoperiod (CP13). 

[0823] Other examples can be constructed with different relative positions of cryptoperiods and segments, but it can 
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be observed that with the above formula (and with a combined segment and FIFO size no greater than the size of a 
cryptoperiod), the estimated position always falls within the correct cryptoperiod, or the following cryptoperiod (in both 
cases, with acceptable results). 

[0824] As discussed above, in the preferred embodiment the estimation process is based upon an EVT_CAS_CMM 
5 event derived from an EVT_CAS_ECM event. In fact, in many practical situations the time delay between the 
EVT_CAS_ECM event and the corresponding E VT_C AS_CM M event is relatively small and can be ignored. 

Structure underlying the synchronisation and estimation 

10 [0825] The various structures underlying the methods of synchronising and estimation described earlier (particularly 
with reference to Figures 12 and 13) will be described in more detail, with reference to Figures 30 and 31 . 
[0826] In Figure 30, the scrambled bit stream 800 is shown passing through the demultiplexer/remultiplexer/descram- 
bler 2010 (here shown in its remultiplexing capacity) and FIFO 8020 (operated by the FIFO device 3744 - not shown) 
on its way to being stored in the file portion 2110 in the hard disk 21 00 (operated by the mass storage device 3728). 

15 The MLOAD device 3438 extracts ECMs 5602, and URMs 5612 and CMPS_EMMs 5614, and forwards these to the 
conditional access system 5000 and CM PS 2300 respectively. Control words 5600 decrypted by the conditional access 
decryption engine 8500 in the conditional access system 5000 are sent to the CMPS 2300, accompanied by the broad- 
cast of an EVT_CAS_ECM event 8400. As described earlier, the control words (two per CMM for redundancy), URMs 
5612 and CMPS_EMMs 5614 are combined and encrypted by the CMPS decryption engine 8550, and then sent, via 

20 the HDVR 3850, and the mass storage device 3728, to the hard disk 21 00 for storage in the management data portion 
2112 of the relevant file. EVT_FIFO_WRITE_COMPLETED events 8410 are broadcast periodically (and received by 
the HDVR 3850 in preferred embodiments, or alternatively by the CMPS 2300 directly) when a segment write operation 
has completed. EVT_CAS_CMM events 8552 are sent from the CMPS 2300to the HDVR 3850. As discussed above, 
the EVT_CAS_CMM events 8552 are used as the basis of estimation in the preferred embodiment. 

25 [0827] In Figure 31 , the demultiplexer/remultiplexer/descrambler 2010 produces the desired unscrambled bit stream 
810 by descrambling the scrambled bit stream 800 from the portion 2110 with control words 5600 generated by the 
CMPS decryption engine 8560 in the CMPS 2300. The above-mentioned decryption engine 8560 is fed by CMMs 
retrieved from the management data portion 2112 of the relevant file in the hard disk 21 00 via the mass storage device 
3728, and also produces URMs 5612 and CMPS_EMM 5614 for further processing by the CMPS 2300. 

30 

Segment size 

[0828] Returning to other considerations, it is noted that cryptoperiods have a predetermined size in the time domain 
only, their corresponding data size varying with the bit rate of the bit stream. A further consideration is that particularly 
35 'safe' (in other words, small) segment sizes relative to the expected sizes of cryptoperiods are inefficient, since the 
more EVT_FIFO_WRITE_COMPLETED events which are generated per second, the more processing power is un- 
necessarily used up. 

[0829] The optimal segment size is now considered in more detail: 

40 a small amount of data in a segment allows many segments to be created per cryptoperiod. This may allow more 

precise measurements, but creates the risk of having too many events per cryptoperiod, which can lead to a 
degradation of computational efficiency; 

a medium amount of data in a segment provides a compromise between large and small segments. This includes 
a range of possible segment sizes and the optimum size must be chosen from this range; and 
45 a large amount of data in a segment creates fewer, larger segments per cryptoperiod. This has the advantage of 

requiring less processing because of fewer segment end events, but too large a segment can (potentially fatally) 
cause more than one EVT_CAS_ECM event to be received during the writing of the segment. 

[0830] To recap, although the smallest segments create the most accurate estimates, using small segments requires 
50 more processing and is therefore slow. The bit stream is divided into segments that are as large as possible to keep 
processing to a minimum, while keeping the estimates as accurate as possible. To this end, various medium-sized 
segments are generally preferred as a useful compromise between speed and accuracy. 

[0831] In view of the above consideration of segment size, a further important aspect of the system relates to the 
determination of appropriate segment size so as to maximise efficiency (or, in other words, maximise the segment 
55 size) whilst retaining 'safe' estimates of ECM position. 

[0832] This determination of appropriate segment size is done by applying filters to observed characteristics of the 
bit stream, such as bit rate. This filtering, as with the estimation, is performed by the CMPS 2300. The filtering in most 
cases serves to reduce the susceptibility of the estimation procedure to large fluctuations in bit rate. 
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[0833] The use of filters and other means to optimise the segment size used to store portions of the bit stream to 
hard disk will now be described in more detail. 

Optimising segment size 

[0834] Numerous methods can be used to optimise the segment size ; typically utilising at least one characteristic of 
the bit stream to help determine the segment size. 

[0835] In the preferred embodiment, a dynamic filter is used whose inputs are measurements of the average bit rate 
of the bit stream, and whose output is the segment size. In general, however, two main types of filter are considered 
here: static and dynamic filters. Implementations of these filters will now be described, as well as a discussion of their 
relative merits. 

[0836] First of all, static filters will be described. 

[0837] The principal characteristic of the static filter is that the size of the segments is as close to constant as possible. 

Static filters are more easily employed than dynamic filters because no processing of the bit stream is required to 

determine optimum segment size as in the case of dynamic filters, but they deal less well with large variations in bit 

rate. However, static filters have a tendency to create too many events per cryptoperiod, causing the manipulation of 

the bit stream to degenerate and the theoretical accuracy to quickly diminish. 

[0838] Constraints affecting the choice of this constant segment size include the following: 

[0839] The size of the segment must not exceed a cryptoperiod in length (also taking into account buffered data) 



Size_Segment (Mb) < bit rate (Mb/s) x cryptoperiod (s) - FIFOSize (Mb) 
[0840] The maximum size of transfer (segment size) is limited 

Size_Segment (Mb) < 32 (Mb) 

[0841] The following assumptions regarding the above parameters are not unreasonable: 

One cryptoperiod is at least 6s 

The bit rate is at least 1 Mb per second 

FIFOSize is less than or equal to 32 Mb (and typically 2 Mb) 

[0842] These above assumptions give the result that: 



Size_Segment (Mb) < 6 (Mb) - FIFOSize (Mb) 



(and consequently that FIFOSize «6). 

[0843] With the typical FIFOSize of 2 Mb, the segment size is therefore 4 Mb. 
[0844] Dynamic filters will now be described. 

[0845] A dynamic filter adjusts the size of the segment to accommodate the bit rate. High bit rates have short duration 
segments and vice versa. The dynamic filter must, however, compromise between few large segments and many small 
segments. If the bit rate is low or constant, the segments can be large, creating fewer events per cryptoperiod while 
still affording the resolution necessary for the recording and synchronisation of the bit stream. If the bit rate is high or 
varies greatly, the smallest segments are required to afford the most accurate measurement, but create many events 
per cryptoperiod, thus degrading the bit stream manipulation. The aim of the dynamic filter is to create the largest 
segments possible for the bit stream. 

[0846] The dynamic filter attempts to limit the segment size to the equivalent of a time expressed as a fraction of the 
cryptoperiod (referred to below as the 'segment writing time 1 ). The factor defining the segment writing time is an integer 
called the 'security coefficient 1 , such that: 



segment writing time = Wpoperiod 

security_coefficient 

[0847] There are 3 different types of dynamic filter discussed below; rapid, inertial and hybrid filters. In the preferred 
embodiment, a hybrid dynamic filter is used, but in variants of the preferred embodiment other types of static and 
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dynamic filter are used. 

[0848] The rapid dynamic filter takes into account the writing time of the preceding segment in order to determine 
the size of the subsequent segment. First the rapid filter calculates the time taken to write the previous segment 
(time_segment(n-1 ) - time_segment(n-2)) ) and then calculates the corresponding average bit rate (equal to the size 
of the segment divided by the time taken). The size of the segment (n), size_segment(n) is then given by the formula: 



size segmentin - 1) ^ cryptoperiod 

size segment = - — = — fr — — x .7 — — x 

~ time_segment(n - 1) - time_segment{n - 2) secunty_coeffiaent 

[0849] Time_segment(n) is the absolute time of the reception of the event of that segment (n) (ratherthan the duration 
of the segment). 

[0850] In equilibrium (that is, with a constant bit rate), the filter gives security coefficient number of writes per cryp- 
toperiod, regardless of the actual bit rate. In the case of a low bit rate, the limit value of the size of the segment is the 
same as that of the static filter case, that is, size_segment = 4 Mb. 

[0851] As an example of the use of a rapid dynamic filter with a constant bit rate, using the above formula, if the 
value of the cryptoperiod is fixed at 1 0 seconds and a security coefficient of 4 is chosen, a segment event takes place 
every 2.5 seconds. In the case of a constant bit rate, the system converges towards the limit as defined above. 
[0852] The principal constraint on the dynamic filter is as follows: 



time_segment(n) - time_segment(n-1 ) < 1 cryptoperiod 



[0853] It can be deduced that at the segment border, the average bit stream (averaged over one cryptoperiod/ 
security coefficient) does not exceed the security coefficient relationship given earlier. The stability of the filter is guar- 
anteed in this case if: 



average_bit_rate (t+ cryptoperiod) > average_bit_mte (t) x security coefficient 



[0854] From this example it can be seen that the bit rate dynamic is linked to the security coefficient by the following 
relationship: 



r rt+cryptoperiod 



Dyn 



bitrate.dt 



\ 



cryptoperiod 



^20 x log(sec urity _ coefficient 
cryptoperiod J 



dB I s 



[0855] The security coefficient value which defines the "robustness" parameter of the filter during bit stream variation 
is determined by real MPEG-2 flow examinations under test conditions. This is to obtain control values for the filters 
so that security parameters and limits may be established. 
[0856] The second type of dynamic filter is an inertial multilevel filter. 

[0857] The principle of this filter is the same as that of the rapid dynamic filter, in that it estimates the bit rate of a 
variable bit rate bit stream using the bit rates of previous segments; however, the estimation process is given a larger 
memory (that is, effectively it has more filter coefficients). Here, the average bit rate is taken as the overall average of 
the average bit rates for the previous security coefficient number of segment write operations. The estimation of this 
filter has a higher inertia than the first level filter, which allows it to be more stable, though it may be less sensitive to 
the peaks of the bit streams. The inertial filter is similar to the rapid filter in that it uses the writing time values from the 
segment(n-security_coefficient) to the segment(n-l) in order to obtain the size of the segment(n). 
[0858] The formula of the filter is as follows (geometric form): 



55 



EP 1 286 351 A2 



size_ segment = 



5 



cryptoperiod 




time_ segment(n - i - I) - time_ segment(n - i) J security^ coefficient 



size_segment(n -i) | cryptoperiod 



(in arithmetic form): 



10 



size_ segment = 




size segment (n - i) ^ cryptoperiod 



cryptoperiod 



iime_ segment (n - / - 1) ~ time_ segment (n - 0 ) sec urity _ coefficient 



15 



[0859] The limit values for a constant bit rate in the dynamic filter are identical to those of the static filter, and those 
with dynamic limits are equivalent in terms of performance to those of a rapid filter, the only difference being the re- 
20 sponse time of the inertial filter (at the security_coefficient level) which has a memory of one cryptoperiod rather than 
a memory of a cry p\opex\oti/ security coefficient as for the rapid filter. 

[0860] This inertia of the inertial filter particularly allows the reduction of very high peaks (and thus the possibility of 
the decreased sensitivity to those peaks), that is, peaks of a higher dynamic than the security ^coefficient allows. The 
static filter achieves an optimum value if peaks are extinguished although the inertia of the memory filter may eliminate 
25 other values along with this artefact. 

[0861] The third type of dynamic filter is a hybrid hysteresis filter. 

[0862] The two dynamic filters described above (rapid and inertial multilevel dynamic filters) are combined to give a 
better performing filter. The resultant hybrid filter combines the best characteristics of the two filters. The rapid filter 
has the good response time necessary in case of a sudden bit rate drop, but when it identifies a localised peak in a 
30 segment, it can overestimate the size of the subsequent segment because of the large value being included in the 
averaging process. On the other hand, the inertial filter can dampen bit rate peaks, but its response time limits effec- 
tiveness when there are successive drops. 

[0863] The hybrid filter accommodates for the hysteresis effect (that is, the difference in its reaction to rising and 
descending fronts in the bit rate) by combining the rapid and inertial filters and keeping the flexibility of an inertial filter 
35 on a rising bit stream front in orderto dampen any localised peaks; and the reactivity of the rapid filter on a descending 
bit stream front in orderto compensate for the transitions of the high bit rate bit streams towards low bit rate bit streams. 
[0864] The behaviour of the filters has been investigated using simulations of typical bit streams, which will now be 
described. 

40 Bit rate simulations 

[0865] Different bit rate patterns are investigated in Figures 32 to 39 using the four filters described above: static, 
rapid dynamic, inertial dynamic and hybrid dynamic filters. 

[0866] The objective of the simulation is to observe the behaviour of the filters out of their stable behaviour zone 
45 (that is, not at a constant bit rate). To achieve this, different input bit rate functions are investigated, including a sinu- 
soidally varying bit rate (Figures 32 showing the results of the static filter; Figures 33 for the rapid filter; Figures 34 for 
the inertial filter; and Figures 35 for the hybrid filter), a step function bit rate (Figures 36 for the hybrid filter only), a 
triangular function bit rate (Figures 37 for the hybrid filter only), a top hat function bit rate (Figures 38 for the hybrid 
filter only), and a single peak bit rate (Figures 39 for the hybrid filter only). 
so [0867] In each set of figures, the figure denoted "a" shows the bit stream overtime and the figure denoted "b" shows 
the resulting writing time over the number of segments. 

[0868] The figures denoted "a" in each set of Figures 32 to 39 have vertical lines showing the transition between 
segments. As can be seen from Figure 32a (the static filter case), for example, a constant segment size takes a short 
time at high bit rates - reflected in the bunching together of segment transitions at approximately 3 ; 16, 28 and 41 
55 seconds - and a relatively longer time at lower bit rates - reflected by the large (temporal) segment widths at approxi- 
mately 9, 22, 35 and 47 seconds. As described above, the aim is to avoid such bunching of segments (which results 
in an unnecessary degree of accuracy at the expense of computational efficiency) - in other words, aiming for larger 
segment sizes at high bit rates. 
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[0869] The figures denoted "b" in each set of figures each indicate the 'crash line' 8600, which is equivalent to the 
cryptoperiod duration (in this case, 6 seconds). As noted previously, a writing time in excess of this duration can cause 
the estimation to fail (because more than one ECM may arrive during the writing of the segment). For the dynamic 
filters (Figures 33 to 39), there is a second horizontal line which shows the writing time to which the dynamic filter 
5 converges. 

[0870] As mentioned previously, Figures 32to 35 relate to asinusoidally varying bit rate simulation lasting 50 seconds; 
in this case, each cryptoperiod lasts 6 seconds, and a security coefficient of 4 is chosen. 

[0871] The static filter, rapid filter and dynamic filter create 100, 33 and 28 segments respectively (the fewer the 
segments, the better the filter, in general). The segment writing times are all observed to be below the crash line (that 

10 is, less than the cryptoperiod in length), and there is no observed instability in the behaviour of the filter. 

[0872] In this test, the hybrid filter offers the best correction of the three dynamic filters and so the other bit rate 
simulation results focus only on this filter. The tendency towards instability is corrected by the hysteresis phenomenon 
between the increase and decrease, which is illustrated by the damping 8700 on the increasing front and increased 
reactivity 8750 on the decreasing front as shown in Figure 35b. 

15 [0873] As mentioned previously, Figures 36 relate to a step function bit rate simulation lasting 50 seconds; in this 
case, each cryptoperiod lasts 6 seconds; and a security coefficient of 4 is chosen. The bit rate of the bit stream is 1 
Mb/s for 25 seconds and then 8 Mb/s for the subsequent 25 seconds, creating a step between two different constant 
bit rates. The object of this simulation is to investigate the behaviour of the filter around the typical minimum bit rate. 
[0874] The dynamic filters (rapid, inertial and hybrid) have the same characteristics at minimal flow as the static filter. 

20 However, they converge towards the limit of cryptoperiod/ security_coefficient. A maximum bit rate limit of 8 Mb/s is 
determined. 

[0875] As mentioned previously, Figures 37 relate to a triangular bit rate simulation lasting 50 seconds; in this case, 
each cryptoperiod lasts 6 seconds; and a security coefficient of 4 is chosen. The objective of this simulation is to observe 
the behaviour of each of the filters when faced with a bit rate which increases then decreases. 
25 [0876] The hybrid filter combines the elevated response time of the inertial filter on the rising portion 8850 of the 
triangular bit rate function, with the strong reactivity of the rapid filter during the decreasing portion 8900 of the triangular 
bit rate function. 

[0877] As mentioned previously, Figures 38 relate to a top hat function bit rate simulation lasting 50 seconds; in this 
case, each cryptoperiod lasts 6 seconds; and a security coefficient of 4 is chosen. The bit rate consists of a 'top hat' 
30 at 8 Mb/s on a base of 2 Mb/s. The maximum limit allows the hybrid filter to be at an established bit rate on the bit rate 
plateau at 8 Mb/s. 

[0878] As mentioned previously, Figures 39 relate to a single peak bit rate simulation lasting 50 seconds which also 
incorporates an element of noise; in this case, as before, each cryptoperiod lasts 6 seconds; and a security coefficient 
of 4 is chosen. The bit rate has a weak average noise value around 2 Mb/s, and it presents a very localised bit rate 
35 peak for 2 seconds with a height of 1 8 Mb/s. The objective is to show the hybrid filter's capacity for damping a strong 
bit rate peak which is greater than its correction capacity, in order to compensate for anomalous bit rate measurements 
when estimating the bit rate. 

[0879] The hybrid filter compensates for the large data peak by underestimating the number of segments required 
for that amount of data, thus damping the effect of the data peak in the bit rate estimation procedure. 

40 

Further methods of estimation 

[0880] As mentioned earlier, further methods of estimating the position of ECMs in the stored bit stream are envis- 
aged. One set of methods can be implemented, for example, which form the estimate in dependence on a characteristic 
45 of the bit stream (as opposed to forming the estimate as an offset from the end of a particular segment, for example, 
as described above), such as the average bit rate, or time elapsed between points in the bit stream. 
[0881] One such method will now be described. 

[0882] The following method further assumes that, in contrast to the foregoing, the file write pointer (FWP) can be 
established at the time when the EVT_CAS_ECM is received (but not at the time when the ECM itself is received). 
so [0883] The position of the ECM in the bit stream can then be estimated in four steps: 

1 . An estimation is made regarding the time offset between the reception of the ECM in the bit stream and the 
event signalling the arrival of the corresponding control word ("At"); 

2. An average bit rate during this time period is estimated; 

55 3. The amount of data "Ad" corresponding to this time period is calculated as the product of At and the bit rate; and 

4. The position ("d") of the ECM in the bit stream is then calculated as the present position (FWP) less the data 
offset ("Ad") found above. 



57 



EP 1 286 351 A2 



[0884] These steps will be described in more detail below, beginning with the first step (estimating At). 
[0885] Typically, the value of At is assumed, rather than estimated perse, since the time taken to decrypt a control 
word is approximately constant (of the order of a couple of seconds). If possible, however the error in at least one 
previous estimate can be measured, and used to correct future estimates. Other means may of course be provided 
5 for estimating At. 

[0886] The second step (estimating the average bit rate) will now be described in more detail. 
[0887] For simplicity, the average bit rate may be calculated in respect of the entire period between successive 
EVT_CAS_ECM events (approximately a cryptoperiod in duration) or preferably in respect of a shorter period, such 
as the length of a segment. In each case, the bit rate is calculated as total data offset divided by total time. 
10 [0888] The third step (calculating the data offset) will now be described in more detail. 

[0889] The product of the bit rate estimate and the At estimate gives Ad, the estimated amount of data elapsed since 
the reception of the ECM: 

15 Ad (Mb) = Bit rate (Mb/s) x At (s) 

[0890] The fourth step (estimating the position of the ECM) will now be described in more detail. 

[0891 ] Knowing the estimated data offset from the receipt of the ECM , the position of the ECM d can then be estimated 

by subtracting Ad from the current file write position (FWP): 

20 

d=FWP-Ad 

[0892] As mentioned above, other methods of estimating the position of the ECM in the bit stream can of course be 
25 implemented, and the methods of estimating described above may of course be subject to minor variations, not least 
to take into account different information which may be available at any particular time. 

[0893] The precise details of the implementation of the various functions described above, and their distribution 
between hardware and software, are a matter of choice for the implementor and will not be described in detail. It is, 
however, noted that dedicated integrated circuits capable of performing the operations required in the receiver/decoder 
30 are commercially available or can be readily designed, and these can be used as the basis for a hardware accelerator 
or more preferably modified to produce a dedicated hardware accelerator, to implement various of the operations 
required, thereby reducing the processing power required to run the software. However the operations required may 
be implemented in software if sufficient processing power is available. 

[0894] The modules and other components have been described in terms of the features and functions provided by 
35 each component, together with optional and preferable features. With the information given and specifications provided, 
actual implementation of these features and the precise details are left to the implementor. As an example, certain 
modules could be implemented in software, preferably written in the C programming language and preferably compiled 
to run on the processor used to run the application; however, some components may be run on a separate processor 
and some or all components may be implemented by dedicated hardware. 
40 [0895] The above modules and components are merely illustrative, and the invention may be implemented in a 
variety of ways, and, in particular, some components may be combined with others which perform similar functions, or 
some may be omitted in simplified implementations. Hardware and software implementations of each of the functions 
may be freely mixed, both between components and within a single component. 

[0896] It will be readily understood that the functions performed by the hardware, the computer software, and such 
45 like are performed on or using electrical and like signals. Software implementations may be stored in ROM, or may be 
patched in FLASH. 

[0897] Turning to a third general aspect of preferred embodiments, command sets for controlling the transfer of a 
bitstream are now described in more detail. 

50 COMMAND SET 

Command set 

[0898] The Personal Video Recorder application (henceforth referred to as the 'PVR') 31 54 mentioned above is part 
55 of a Personal Video Recorder system ('PVR system') which allows the user to record audio and/or visual data (principally 
programmes broadcast to the receiver/decoder) to a mass storage device, such as the hard disk 2100, and also to 
play back such audio/visual data. The data is stored as sequentially-ordered data (in MPEG-2 format in the preferred 
embodiment) and in essence the PVR provides the user with different ways to access this or similar data (indeed, a 
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corresponding application for recording and playing back purely audio content is also provided, using fundamentally 
the same principles as will now be described). 

[0899] With reference to Figure 40, the PVR system will now be described in more detail. The hard disk 2100 (or 
other mass storage device) is connected via Fl FOs and memory buses (not shown) to both the demultiplexer/descram- 
5 bler/remultiplexer 2010 and MPEG decoder 2028, such that audio/visual data can be routed freely between the live 
broadcast signal input (outputted by the tuners and demodulators, not shown), receiver/decoder memory (not shown), 
MPEG 2 decoder (for display on the connected television, not shown) and hard disk 2100. 

[0900] The hardware components mentioned are controlled by software devices (not shown), and in particular by 
the mass storage device 3728 and (indirectly) the service device 3736. In turn, the mass storage device and service 
10 device are controlled by the hard disk video recorder (HDVR) module 3850, comprising two recording threads 3854, 
3856, a playback thread 3858, and shared filing system library ('FS library 1 ) 3852. Finally, the PVR application 3154 
issues commands to the HDVR module via the program interface 7000. 

[0901] As can be seen in Figure 40, the PVR system is broken down into several layers, with the effect that the PVR 
application, essentially residing at the top of the chain of command, can entirely ignore lower-level considerations such 

15 as allocating space on the hard disk for recording and managing file pointers, and so on. By the careful design of the 
interfaces within the PVR system, as will be described in more detail below, the instructions which the PVR application 
3154 sends to the underlying HDVR module 3850 correspond closely to the sort of axiomatic operations which are 
performed by the PVR, such as commencing playback at a given position in a stored programme, and stepping through 
the programme frame-by-frame. 

20 [0902] Whilst the interface 7000 between the PVR 31 54 and the HDVR module 3850 can allow simpler applications 
to be developed, providing as it does several different commands each corresponding to a typical user operation, the 
interface 7002 between the recording and playback threads 3854, 3856, 3858 by contrast implements a minimal com- 
mand set, in particular providing only two commands for reproduction of data (one to set the reproduction speed, and 
one to set the reproduction position) which can allow the efficiency of the underlying FS library to be increased. The 

25 further interfaces between the FS library and devices, and between the devices and hardware, allow further levels of 
abstraction. 

[0903] Four principal levels of command that are provided will be described later, including a first top-most layer 
701 0 of commands (comprising the PVR routines), a second midrange layer 701 2 of commands (comprising the rou- 
tines in the recording and playback threads 3854, 3856, 3858), a third layer 7014 of commands (comprising the FS 

30 library routines), and a fourth bottom-most layer of commands, comprising automata 7016. As mentioned above, of 
course, further layers of commands exist below and possibly abovethese four layers, buttheseare as earlier described. 
[0904] Underlying the playback aspects of the PVR system are the concepts of 'current reproduction position' and 
'current reproduction speed' (referred to elsewhere simply as 'current position' and 'current speed' respectively). These 
two values are interpreted by the hardware (hard disk, demultiplexers, remultiplexers, MPEG-2 decoder and/or FIFO 

35 systems) to control the playback of programmes and/or other data stored on the hard disk 2100, and can be altered 
by various parts of the controlling software, as will be described in more detail later. In terms of the recording aspect 
of the PVR system, the concept of 'current recording position' is known, but by contrast a 'current recording speed' is 
meaningless. 

[0905] It should be noted that only the aspects of the interface relating to the HDVR playback thread 3858 will be 
40 considered here, but the reader will understand that the general principles described here can also be applied to the 
recording threads 3854, 3856 and their respective interfaces. 

[0906] With reference to Figure 41 , in overview, the six commands in the HDVR playback thread 3858 (the second 
command layer 7012) which are available to the PVR application 3154 (the 'HDVR playback routines') are shown: a 
seek_single_play() 7040, seek_slow_play() 7042, seek_normal_play() 7044, seek_fast_play() 7046, single_play() 

45 7048 and pause() 7050 routine. In turn, the FS library 3152 (third command layer 7014) provides two commands (the 
'FS library routines'): a set_pos() 7030 and a set_speed() 7032 routine. The PVR application 3154 is also shown (first 
command layer 7010), its constituent functions being described later, and below the FS library 3852 various devices 
are shown (such as the service device and mass storage device) with which the set_speed() and set_pos() routines 
communicate. The arrows in the figure indicate function calls which are typically made by each object or routine. 

50 [0907] The third command layer 7014, comprising the set_pos() 7030 and set_speed() 7032 routines, will first be 
described. 

[0908] The set_pos() and set_speed() routines have been provided following the discovery that any combination of 
typical playback operations, including the six routines 7040, 7042, 7044, 7046, 7048, 7050 provided by the HDVR 
playback thread 3858, could be distilled to a sequence of axiomatic commands setting either the current reproduction 
55 speed or current reproduction position. 

[0909] The set_pos() routine sets the current position of reproduction within a stream to a position specified as a 
parameter. In the preferred embodiment the parameter is a time offset in centiseconds from the beginning of the stored 
stream, but in variants of the preferred embodiment, different units are used. In further variants, the parameter specifies 
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a byte-offset (or other spatial offset) from the beginning of the stored stream. As noted below, this latter variant is more 
efficient, but presents certain difficulties. 

[091 0] The set_pos() command in turn sends a command containing the relevant byte-offset to the lower level device 
(s), such as the mass storage device 3728. It is important at this stage to recognise that a byte-offset from an origin 

5 in many types of encoded video or audio stream (and in MPEG 2, in particular) does not have a constant linear relation 
to the time offset from that origin. Therefore, in the preferred embodiment, a translation is required internally between 
the time offset and the spatial offset. This can be achieved to a given temporal resolution by using tables which map 
time offsets to byte-offsets, and refined by subsequently scanning and decoding a short length of the MPEG 2 data to 
find the desired frame. In a further variant, the parameter of the set_pos() command is an index into the above-men- 

10 tioned table of byte-offsets. 

[0911] For performance reasons, whenever the set_pos() command is invoked, it jumps to the specified position and 
then scans forward to find and display the first l-frame (or equivalent independent - as opposed to dependent - frame 
in formats other than MPEG) after that position. Since l-frames may typically occur every half second, this behaviour 
can result in slight 'jerkiness 1 in some applications (described below). In variants of the preferred embodiment, however. 

15 the set_pos() command causes the MPEG decoder to scan backwards until it finds the previous l-frame, and then 
forward again to the desired position (which can be a non-l-frame, such as an interpolated frame). Whilst slower this 
latter behaviour can result in generally smoother playback (if the decoder is sufficiently advanced). 
[0912] The set_speed() routine sets the speed at which the stream is processed to the speed specified as a param- 
eter. Again bearing in mind the non-linear relationship between byte-offset and time, the speed is specified as a multiple 

20 of normal playback speed (that is, a parameter of greater than 1 is equivalent to fast-forwarding, and a parameter of 
less than 1 is equivalent to slow-play. Passing a parameter of 0 has the effect of pausing reproduction, and a negative 
parameter is equivalent to rewinding the stream. In variants of the preferred embodiment, the parameter is specified 
in different units, such as the number of frames per second (for example, 30 for normal playback), orthetime in seconds 
between frames (the inverse of the number of frames per second, for example, 1/30 for normal playback). For video 

25 sources with a constant bit rate, or in situations where the variation in bit rate is forthe given purpose possible to ignore 
(at high speeds of fast forwarding or rewinding, for example), the speed may also be specified in terms of bitrate. 
[091 3] The nature of some encoding methods used for audiovisual and/or other types of data (such as M PEG 2, for 
example) is such that it cannot be read other than by starting from a given point, and advancing forward through the 
signal in one direction, whereby a time point in the video signal advances as decoding proceeds. In other words, it 

30 cannot be decoded backwards. This is, in particular, the case for a video programme encoded in MPEG 2 format in 
the form of a collection of transport packets. This is independent of the transfer speed. In order to reproduce the data 
in a time-reversed manner, multiple short read operations are performed at successively earlier points in the stream, 
each time obtaining and then outputting a single frame, giving the impression of a time-reversed video signal. 

35 Automata 

[0914] The fourth layer 7016 of commands implements an automaton which validates navigation functions, and 
transitions between navigation states. 

[0915] The automaton implemented by the fourth layer 701 6 in preferred embodiments validates the linking of nav- 
40 igation functions as shown in the table. 
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Action for the automaton 
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State of the Automaton 



[091 6] The letters a and b used in the table represent speeds of either playing, slow forwarding or rewinding, or fast 
forwarding or rewinding. 

[0917] The symbols in the lefthand column represent the state of the automaton upon receipt of a command, the 
25 symbols in the top row represent commands sent to the automaton, and the entries in the table represent the corre- 
sponding states of the automaton after execution of the commands. 

[0918] So for instance, if the initial automaton state is fast forwarding at speed a, and a jump chapter forward com- 
mand is received, the system will jump forward one chapter and then play out at normal speed, rather than continuing 
to fast forward through the new chapter. 

30 [0919] The fourth command layer receives set_position and set_speed commands from the third command layer 
and, given the current state of the system, validates that the commands would produce a transition to an allowed state. 
If the commands would produce a transition to an allowed state then the commands are passed for execution. 
[0920] If the commands received by the fourth command layer would produce a transition to a state which is not 
allowed by the automaton, then in the simplest case the fourth command layer would cause the command to be ignored. 

35 [0921] However, in preferred embodiments, and for certain commands, and states of the system, if the commands 
received by the fourth command layer would produce a transition to a state which is not allowed by the automaton, 
then rather than causing the command to be ignored, the fourth command layer alters either the set_position or 
set_speed command and then checks whether this new command would produce a transition to a valid state. If so, 
the new command is passed for execution, and if not the command is again altered. This recursive attempt to validate 

40 a command, followed by amendment of the command proceeds until a command is produced which would cause a 
transition to a valid state. 

[0922] So, for instance in particular embodiments it is not allowed to jump to a new position in a file during a fast 
forwarding operation. 

[0923] Initially, during a fast forwarding operation the state of the system may be expressed by the following table, 
45 which records the state of the current set_position, X, and set_speed, V, commands, and flags whether these states 
have changed (flag value=1) or remain the same (flag value=0). 



50 





Current state of command 


Flag value 


X 


0 


0 


V 


3 


0 



[0924] Upon receipt of a command to jump to a new position, the table changes:- 





Current state of command 


Flag value 


X 


1 


1 
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(continued) 





Current state of command 


Flag value 


V 


3 


0 



[0925] The fourth command layer checks whether this transition is allowed, and then as the transition is not allowed 
in this case, causes the set_speed state to be altered, until a valid transition is found:- 





Current state of command 


Flag value 


X 


1 


0 


V 


1 


0 



15 [0926] The flags are reset to zero as shown in the above table, the commands are executed, and the system plays 
out content at normal speed from the new position. 

[0927] The fourth command layer is linked to parental control and conditional access mechanisms in preferred em- 
bodiments. States are allowed or disallowed by the automaton in dependence, in part, upon parental control or con- 
ditional access parameters. 

20 [0928] So, for instance, it is not allowed to fast forward or rewind through particular chapters in a file containing 
advertisements, orto jump to particular chapters containing adult content, if the user does not have permission to view 
such content. 

[0929] An example of the operation of an embodiment in which the fourth command layer is linked to a parental 
control mechanism is described below. 
25 [0930] The state of the system is again expressed by a table, which records the state of the current set_position, X, 
and set_speed, V, commands, and flags whether these states have changed (flag value=1) or remain the same (flag 
value=0):- 



30 





Current state of command 


Flag value 


X 


1 


0 


V 


1 


0 



[0931] A set_pos command is then received: 





Current state of command 


Flag value 


X 


2 


1 


V 


1 


0 



[0932] This command corresponds to a jump in position to a chapter which the user does not have permission to 
view. The fourth command layer thus causes the set_position to be amended, and checks whether the transition rep- 
resented by these commands is allowed:- 



45 





Current state of command 


Flag value 


X 


3 


1 


V 


1 


0 



[0933] The command corresponds to a jump in position to a later chapter, which again the user does not have per- 
mission to view. The fourth command layer thus causes the set_position to be amended again, and again checks 
whether the transition represented by these commands is allowed. In this case the transition is allowed, the flags are 
reset to zero, the commands are passed for execution and the system plays content from a later chapter than that 
which was originally requested:- 
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Current state of command 


Flag value 


X 


4 


0 


V 


1 


0 



[0934] Before commencing a description of the second layer 701 2 of commands, the high-level PVR routines which 
embody the functionality of the PVR application (in the upper-most command layer 701 0) will now be described briefly. 
For the sake of clarity, to avoid confusion with lower-level routines, each routine in the PVR (the 'PVR routines') is 
given a symbol which is closely related to those typically encountered in respect of a conventional video recorder, and 
the symbols are listed below in the table: 



PVR symbols 



Symbol 


Function 


E 


Play 


►► 


Fast forward 




Fast rewind 


> 


Slow forward 


< 


Slow rewind 


& 


Next Index 




Previous index 


c+ 


Next Chapter 


c- 


Previous chapter 


QD 


Pause (freeze frame on an image) 


H 


Stop 



40 



[0935] Typically, each of the above PVR application functions is invoked by the user pressing a single button on the 
remote control, or selecting a single option in an on-screen menu. Thus, they correspond to axiomatic commands from 
the point of view of the user (distinct to axiomatic commands from the point of view of the software (such as the 
set_speed() and set_pos() commands described earlier). Further or alternative functions to those listed above can, of 
course, be envisaged; in particular, the above could be adapted for use as an audio player, for example, with indices 
corresponding to music tracks, say. 

[0936] Still referring to Figure 41 , the six commands provided by the HDVR playback thread 3858, in the second 
command layer 7012, will now be described. 

[0937] As mentioned above, the six commands in the HDVR thread 3858 comprise four 'seek-play' operations: 
seek_single_play() 7010; seek_slow_play() 7012, seek_normal_play() 7014 and seek_fast_play() 7016. In addition to 
these basic operations, there are two other elementary operations: single_play() 7018 and pause() 7020. These op- 
erations together encapsulate the functionality of the above-mentioned set_pos() 7030 and set_speed() 7032 routines 
in higher-level routines which are of more use to the PVR application 3154 and similar applications. These routines 
will now be described in more detail. 

[0938] Each of the seek-play operation sets the positions of a current read pointer in the data stream and then 
continues to reproduce the stream forward of that pointer in one of several modes, in the process making use of both 
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the set_pos 7030 and set_speed 7032 routines to achieve the desired effect. In the preferred embodiment, the param- 
eters of the six routines are equivalent to the parameters of the underlying set_pos() and set_speed() routines (that 
is, centisecond time offsets and multiples of normal play speed respectively). However, in variants of the preferred 
embodiment, different parameters (such as, for example, byte-offsets and inter-frame delay, respectively) may be spec- 
5 ified for the six routines 7010, 7012, 7014, 701 6, 7018, 7020, with the necessary translation of parameters taking place 
within the routines before the set_pos() and/or set_speed() routines are called. 
[0939] The operation of each of these routines will now be described. 

• seek_single_play() sets the current reproduction offset to the offset specified as a parameter of the routine, and 
10 then reproduces a single frame from (or as near as possible to) that offset, whilst the playback remains paused. 

It is used by PVR routines which alter the position in the stream ( [w<] , H, C-, C+) when the playback has been 
paused (0 s ). 

• seek_normal_play() sets the current reproduction offset to the offset specified as a parameter of the routine, and 
15 then reproduces the content of the data stream from that point forward, proceeding through the stream at normal 

speed. It is used during normal playback (as activated by the PVR play routine [ H ]) by PVR routines which alter 
the position in the stream , @, C-, C+). 

• seek_fast_play() sets the current reproduction offset to the offset specified as a parameter of the routine, and then 
20 reproduces the content of the data stream from that point forward, proceeding through the stream at greater than 

normal speed. 

It is used during fastforward play (►►') by PVR routines which alterthe position in the stream ( [w] , @, C-, C+). 

• seek_slow_play() sets the current reproduction offset to the offset specified as a parameter of the routine, and 
25 then reproduces the content of the data stream from that point forward, proceeding through the stream at less 

than normal speed. It is used during slow forward play (>) by PVR routines which alter the position in the stream 
(0., S, C-, C+). 

• single_play() is used by routines that advance frame-by-frame in the stream, when the routine pause (g) has 
30 already been invoked. It is also used in some derived routines, as will be described below. 

• pauseQ is used by the PVR pause routine ([u] ). It causes the stream to be halted at the current frame. There is 
no stop() routine as such, because the HDVR module does not itself directly control the display devices; mecha- 
nisms outside the HDVR module 3850 such as the service device 3736, video device 3734 and FIFO device 3744 

35 are used to actually control the video output, as described in more detail above. 

[0940] In variants of the preferred embodiment, at least two of the seek_fast_play(), seek_slow_play() and 
seek_normal_play() routines are replaced by a single seek_play() routine taking both an offset and a speed as a 
parameter. The possible permutations of these parameters are as described above in respect of the set_pos() and 
40 set_speed() routines. 

[0941] In the preferred embodiment, as noted above, different HDVR playback routines are called by the PVR routines 
depending on the current playback state (paused, normal, slow- or fast-forward). This can advantageously allow the 
HDVR playback routines to be simplified, so that they only need to cope with one mode of playback (such as paused 
or playing, fast-forwarding, rewinding, slow-playing and so on). In variants of the preferred embodiment, however, the 
45 HDVR playback routines are capable of operating in any play mode. 

[0942] At the same time, the underlying set_pos() and set_speed() routines are, like the PVR routines, independent 
of the play mode. In contrast to the HDVR playback routines, the FS library routines are simpler in structure, but 
potentially require more complex coding in order to cope with all eventualities of playback mode. 

so Derived Functions 

[0943] A wide range of derived functions can be implemented using any combination of the three layers 701 0, 701 2, 
7014 of commands described above. The following represents an examples of such functions. In these examples, the 
current reproduction position mentioned above is referred to as 'cur_pos'. 
55 [0944] As has been discussed above, reproducing in a truly time-reversed direction through the data stream is gen- 
erally not possible for MPEG-2 data, and difficult at best otherwise. Therefore, as mentioned above, time-reversed 
play is emulated by jumping backwards through the data stream, at each jump decoding a short segment of the data 
stream to obtain a single frame, and displaying each such frame. 
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[0945] All such operations involving a movement backwards (in a 'rewind' direction) in the stream are derived from 
standard play operations. Description of these operations is illustrated in Figures 42 to 47, in which the data stream is 
represented by a horizontal line, and each vertical arrow represents reproduction of a particular point in the stream. 
During normal play, the stream is played in a left-to-right direction in the figures. 
5 [0946] Furthermore, as can be seen from the following, many routines using the 'seek_play' routines can alternatively 
be derived from only the single_play() routine. 

High speed reproduction in the forward direction » 

10 [0947] This operation may be embodied in the following sequence: 
pause 0 

seek_fast_play (cur_pos) 

[0948] Figure 42 illustrates the operation of theseek_fast_play() routine on MPEG data (comprising periodic l-frames. 
as shown). As can be seen, the audio/visual data is scanned forward at a high rate (limited by the decoding hardware 
15 to a maximum of between 8 to 12 times normal playback speed, for example), and images are periodically displayed 
at the refresh rate. The displayed frames are a mixture of l-frames and non-l-frames, depending on where the MPEG 
decoder had reached at the time for the screen refresh. 

[0949] As noted above, one of the more compact embodiments of the seek_single_play() and related functions takes 
a parameter of the actual data offset in the audio/visual file, instead of the time offset. 
20 [0950] In the case where a very rapid advance is required, and in all additional cases where the MPEG-2 decoder 
is capable of doing so : a short routine can be constructed to effect a fast-forwarding function using the above-mentioned 
data-offset version of the seek_single_play() routine. This short routine is shown below, with reference to Figure 43. 
pause () 

Loop during play_time 
25 cur_pos += constant_data_offset 

seek_single_play (cur_pos) // display the frame at the cur_pos data offset in the audio/visual file 

pause during pause_time // wait for next refresh 
EndLoop 

[0951] This method uses a technique of spaced forward jumps in the stream. The value of play_time corresponds 
30 to the duration for which the command remains active. It is also possible to adjust the value pause_time to modify 
the video rendition. 

[0952] The offset for each jump ('offset' in the code above) can be calculated as a multiple of the average bit rate of 
the audio/visual data, such that an offset of, for example, three times the average bit rate will result in a reproduction 
speed of approximately three times the normal play speed. As can be seen from Figure 43, however, the bit rate of 
35 the audio/visual data is typically not constant with respect to time (certainly for MPEG data), and so a constant data 
increment results in an uneven playback of frames. 

[0953] Nevertheless, using this latter method, the time taken to fast-forward is approximately constant regardless of 
the reproduction speed, so thatthe reproduction speed can be made arbitrarily high (such as 1 28 times normal playback 
speed) and otherwise easily varied during the fast-forwarding operation. It can also be observed that less time is spent 
40 scanning through the data in this example, as not all the data needs to be scanned. 

[0954] A more advanced fast-forwarding operation can be achieved using the following code, similar to the last but 
using the 'time offset' version of the seek_single_play() routine (whereby the current reproduction position is specified 
as a time offset into the audio/visual data). 
pause() 

45 Loop during play_time 

cur_pos += constant_time_offset 
seek_single_play (cur_pos) 
pause during pause_time 
EndLoop 

so [0955] The operation of this code is illustrated in Figure 44. In the present example, the constant_time_offset (and 
the granularity of the above-mentioned table mapping time offsets to data offsets and vice versa) are chosen to be a 
multiple of the period between l-frames. It can be seen that the time taken to decode is more uniform, and the frames 
displayed are equally spaced in terms of time, resulting in a smoother fast-forwarding action. With the modification 
(described previously) to the set_pos() routine to allow it to jump to frames other than l-frames which has previously 

55 been described so that non-l-frames can be decoded, a fast-forward speed of other than a multiple of the l-frame period 
can effectively be used. 

[0956] An example of pseudocode required to perform the conversion between a time offset ('time_offset') and the 
appropriate data offset ('data_offset') using an index table ('index_table') containing both time offset and data offset 
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fields is as follows: 
index = 0 

while (index_table[index].time_offset < time_offset) 
{ index ++ } 

5 data_offset = index_table[index].data_offset 

[0957] The above code can of course be implemented in any of the appropriate routines which are detailed here. A 
slight variation of the above fast-forward routines, adapted to use the index table, is as follows: 
pause() 

cuMndex = GetCurlndex(cur_pos) //find current index using methods detailed above 
10 Loop during play_time 

cur_pos = index_table[cur_index].data_offset 
seek_single_play (cur_pos) 

cur_index+=n // higher values of n give faster effective reproduction speeds 
pause during pause_time 
15 EndLoop 

High speed reproduction in the reverse direction H '■ 

[0958] A basic (and fast) rewind function using data (not time) offsets is as follows (based on the similar example 
20 above for fast-forwarding, and illustrated in Figure 45): 
pause() 

Loop during play_time 

cur_pos - = constant_data_offset 

seek_single_play (cur_pos) // version of the seek_single_play routine using data offsets as parameters 
25 pause during pause_time 

EndLoop 

[0959] As before, the speed of the reproduced video can be controlled by adjusting the duration of the delay (by 
varying the parameter pause_time), and varying the displacement within the stream, by adjusting the parameter 
constant_data_offset. 

30 [0960] Again, it can be seen that the distance between frames is erratic, and the progress backwards uneven. In this 
and the following example, care has to be taken that the jump backwards is sufficiently large to span at least one I- 
frame (otherwise, a loop could be entered which displayed the same l-frame endlessly). 

[0961] A more sophisticated version is shown in Figure 46 ; using time rather than data offsets: This may be done 
as follows, and is illustrated in Figure 45: 
35 pause() 

Loop during play_time 

cur_pos - = constant_time_offset 

seek_single_play (cur_pos) // version of the seek_single_play() routine using time offsets 
pause during pause_time 
40 EndLoop 

[0962] As before, it may be appropriate to allow variation of the reproduction speed within, for example, 1 to 128 
times normal playing speed. 

Slow speed reproduction in the forward direction > 

45 

[0963] As illustrated in Figure 47, this feature can be embodied by the following code: 
pause() 

seek_slow_play(cur_pos) 

[0964] As shown in Figure 47, the effect of the seek_slow_play() command is to scan through the audio/visual data 
50 at a slower-than-normal rate and display all of the frames as per usual (except displaying certain or all of them for more 
than one screen refresh period, depending on the playback speed). 

[0965] An alternative embodiment of the slow-forward command, using the single_play() command is as follows, 
with reference to Figure 48: 
pause 

55 Loop during play_time 

single_play () 
pause during pause_time 
EndLoop 
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[0966] As noted above, the single_play() routine (as opposed to the seek_single_play() routine) advances the audio/ 
visual data stream by one frame (including non-l-frames). The routine differs from the seek_slow_play() variant given 
above in that the speed of reproduction (or more generally, the transfer speed, as described elsewhere) can easily be 
customised by altering the pause_time variable. 
5 [0967] A further routine for achieving slow-forward capability, but using the seek_single_play() command is as fol- 
lows: 

pause 

Loop during play_time 

cur_pos += constant_time_offset 
10 seek_single_play (cur_pos) 

pause during pause_time 
EndLoop 

[0968] This code is the same as one of the routines used to fast-forward, except that the pause_time and 
constant_time_offset are chosen so as to effect fast-forwarding at a speed less than the normal playback speed. This 
15 routine is more useful when the seek_single_play() routine is adapted to jump to non-l-frames as well as l-frames 
(reducing the time granularity from, for example, half a second to the normal refresh rate, such as 1/30 seconds) 

Slow speed reproduction in the reverse direction < 

20 [0969] To effect a slow speed reproduction, the procedure is as for the rewind function ( «), but with values of 
pause_time and current_time_offset chosen such that the (negative) reproduction speed is less than the magnitude 
of the normal playback speed. A typical code fragment is as follows: 
pause() 

Loop during play_time 
25 cur_pos - = current_time_offset 

seek_single_play (cur_pos) 

pause during pause_time 
EndLoop 

[0970] Again, the current_time_offset and pause_time parameters may be varied, and better results will be achieved 
30 with the version of the seek_single_play() routine capable of jumping to non-l-frames as well as l-frames. 

Complex Functions 

[0971 ] The three layers 701 0, 701 2, 701 4 of commands (and more particularly the lower layers 701 2, 701 4) can be 
35 used to construct further commands that perform functions of arbitrary complexity. The following examples illustrate 
the power of the command layers (the 'basic commands') described above. 

Example 1: Sequence of actions - C+, /77j, [Ijj, >, [>) 

40 [0972] Expressed in terms of basic functions, this function can be implemented by the following sequence: 
seek_normal_play (cur_pos) 
cur_pos = chapter_table [next_chapter].time_offset 
seek_normal_play (cur_pos) 
pause() 

45 single_play (cur_pos) 

seek_slow_play (cur_pos) 
seek_normal_play (cur_pos) 

Example 2: Sequence of actions - [*],, [n] , . C- 

50 

[0973] Expressed in terms of basic commands, this function can be implemented by the following sequence: 
seek_normal_play (cur_pos) 
cur_pos = user_table [next_user_index].time_offset 
seek_normal_play (cur_pos) 
55 pause() 

seek_normal_play (cur_pos) 

cur_pos = chapter_table [previous_chapter].time_offset 
seek_normal_play (cur_pos) 
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Example 3: Sequence of actions - C+, fFj, >,© 

[0974] Expressed in terms of basic commands, this function can be implemented by the following sequence: 
seek_normal_play (cur_pos) 
5 cur_pos = chapter_table [next_chapter].time_offset 

seek_normal_play (cur_pos) 
pause() 

Loop during play_time 

cur_pos - = current_time_offset 
10 seek_single_play (cur_pos) 

pause during pause_time 
EndLoop 

seek_slow_play (cur_pos) 
pause() 

15 [0975] As can be observed from the above, the three layers 7010, 7012, 7014 of command sets each provide a 
flexible yet simple interface to higher and lower software layers, and can easily be incorporated into other routines to 
provide higher levels of functionality. 

[0976] The system described above can also be adapted to control general transfers, such as a recording, rather 
than a reproduction, process. Accordingly, for the recording example, the set_pos() command sets the position from 
20 which recording is to take place, and the set_speed() command sets the recording speed (which in some embodiments 
can be set to other than normal recording speeds, to enable recording at lower frame- rates or generally lower quality, 
for example). Furthermore, the recording and reproduction processes can be combined to provide time-shifting func- 
tionality. 

[0977] A brief summary of certain aspects of particular embodiments is now provided. 

25 [0978] A datastream or bitstream may represent a portion of a transmission which is to be recorded. The datastream 
or bitstream includes a plurality of ECMs. An ECM is passed to a decryption stage, where it is decrypted using an 
equivalent to a general exploitation key KG, and the control word (CW) is extracted. The control word is passed to an 
encryption stage where the control word is encrypted using a local exploitation key (KL), as before. The resulting 
Control Management Message (CMM) is then passed to a mass storage device for storage in a header, or management 

30 data portion, of a file. The bitstream is also passed to the mass storage device, and is stored in a content portion of 
the file. The header also includes an index table comprising indices mapping time offsets in the datastream or bitstream 
to data offsets in the file. In further variants of the preferred embodiment, the datastream or bitstream and the plurality 
of generated CM Ms are stored in separate files. 

[0979] Furthermore, pre-recorded mass storage data formats are envisaged whereby the content is stored in a rel- 
35 atively cheap read-only portion of the device, and the control information is stored in a relatively expensive read/write 
portion - the updateability of the control information being required for variants of the preferred embodiment described 
elsewhere which use dynamic CMMs. 
[0980] An alternative embodiment is now described. 

[0981] Again, a datastream or bitstream may represent a portion of a transmission which is to be recorded The 
40 datastream or bitstream includes a plurality of ECMs. An ECM is passed to a decryption stage, where it is decrypted 
using an equivalent to a general exploitation key KG, and the control word (CW) is extracted. The control word is 
passed to an encryption stage where the control word, usage rules data (URM) and access rights (CMP_EMM) - the 
latter being optional - are encrypted using a local exploitation key (KL). The resulting Control Management Message 
(CMM) is then passed to a mass storage device for storage in the header, or management data portion, of a file. The 
45 datastream or bitstream is also passed to the mass storage device, and is stored in a content portion of the file. The 
header also includes an index table comprising indices mapping time offsets in the datastream or bitstream to data 
offsets in the file. In further variants of the preferred embodiment, the CMM and the datastream or bitstream are stored 
in separate files. 

[0982] The procedure followed and issues arising in relation to the CMPS/HDVR interface when recording a pro- 

50 gramme will now be described. 

[0983] At the time of recording a programme, HDVR generates a file whose structure is mainly in two parts: man- 
agement data (for example, hdvr_fHe.management_data) and content itself (for example, hdvr_file.content_data). 
[0984] The first part of the file corresponds (among other things) to local messages (Content Management Messages 
- CMMs) generated and handled by the CM PS, which contain the usage rules of the content as well as the associated 

55 unscrambling keys (the control words in other words). The first part also comprises an index table comprising indices 
mapping time offsets in the bitstream to data offsets in the file. 

[0985] The second part is made up of a partial transport stream (pTS) corresponding to the various components of 
a given programme (video, audio, subtitles, and so on) and remains scrambled, as broadcast, in the common scrambling 
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format DVB_CS. In variants of the preferred embodiments, the management data and content are stored in at least 
two separate files. 

[0986] As mentioned above, the hdvr_file.management_data part of the file also comprises an index table comprising 
indices mapping time offsets in the bitstream to data offsets in the file. Two types of indices are included in the index 
5 table, HDVR indices, which are inserted automatically by the HDVR, and User indices, which are inserted upon com- 
mand of a user. 

[0987] The HDVR indices are positioned by the HDVR at intervals corresponding to periodic time offsets in the 
bitstream and are used as play entry points in the recorded file. In preferred embodiments, HDVR indices are generated 
by an HDVR automatically during the recording of a programme. 
10 [0988] The User indices are also play entry points, and are set by a user at the time of recording of a programme or 
during playback of a recorded programme. 

[0989] The Indextable also comprises pointers mapping each HDVR and User index to an appropriate CMM , enabling 
decryption of the stored bitstream at the points indexed by then HDVR and User indices. 

[0990] Processing recorded content, for instance searching for points in a file, or a corresponding bitstream, and 
15 "trick mode" operations such as fast forwarding . rewinding, and skipping make use of HDVR and User indices stored 
in the index table. 

[0991] The precise details of the implementation of the various functions described above, and their distribution 
between hardware and software, are a matter of choice for the implementor and will not be described in detail. It is, 
however, noted that dedicated integrated circuits capable of performing the operations required in the receiver/decoder 
20 are commercially available or can be readily designed, and these can be used as the basis for a hardware accelerator, 
or more preferably modified to produce a dedicated hardware accelerator, to implement various of the operations 
required, thereby reducing the processing power required to run the software. However, the operations required may 
be implemented in software if sufficient processing power is available. 

[0992] The modules and other components have been described in terms of the features and functions provided by 
25 each component, together with optional and preferable features. With the information given and specifications provided, 
actual implementation of these features and the precise details are left to the implementor. As an example, certain 
modules could be implemented in software, preferably written in the C programming language and preferably compiled 
to run on the processor used to run the application; however, some components may be run on a separate processor, 
and some or all components may be implemented by dedicated hardware. 
30 [0993] The above modules and components are merely illustrative, and the invention may be implemented in a 
variety of ways, and, in particular, some components may be combined with others which perform similar functions, or 
some may be omitted in simplified implementations. Hardware and software implementations of each of the functions 
may be freely mixed, both between components and within a single component. 

[0994] It will be readily understood that the functions performed by the hardware, the computer software, and such 
35 like are performed on or using electrical and like signals. Software implementations may be stored in ROM, or may be 
patched in FLASH. 

[0995] It will be understood that the present invention has been described above purely by way of example, and 
modification of detail can be made within the scope of the invention. 

[0996] Each feature disclosed in the description, and (where appropriate) the claims, and the drawings may be pro- 
40 vided independently or in any appropriate combination. 

[0997] Reference numerals appearing in the claims are by way of illustration only and shall have no limiting effect 
on the scope of the claims. 



45 Claims 

1. A table comprising at least one record mapping a respective data offset in a file containing a representation of a 
bitstream to a corresponding time offset in the bitstream, wherein the representation of the bitstream is encoded. 

50 2. A table according to Claim 1 , wherein at least one record in the table is mapped to decoding data. 

3. A table according to Claim 1 or 2, wherein the value of the at least one respective data offset and/or the at least 
one respective time offset is chosen in dependence upon a characteristic of the bitstream and/or the representation 
of the bitstream. 

55 

4. A table according to any of Claims 1 to 3, wherein the bitstream is a variable bitrate bitstream. 

5. A table according to any of Claims 1 to 4, wherein the table comprises at least three records, and the time offsets 
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are periodic, and preferably the period of the time offsets is varied. 

6. A table according to Claim 5, wherein the period of the time offsets is chosen to match a characteristic of the 
bitstream, and is preferably 0.5, 1 , 2 or 10 seconds. 

5 

7. A table according to Claim 5 or 6, wherein the period of the time offsets is chosen in dependence on a characteristic 
of the stored representation of the bitstream, and preferably in dependence on the size of a cryptoperiod. 

8. A table according to any of Claims 1 to 7, wherein:- 

10 

the bitstream comprises at least one portion of bitstream data which can independently be used to regenerate 
a respective at least one portion of audiovisual data; and 

the time offset of the at least one record corresponds to the respective at least one portion of bitstream data. 

15 9. a table according to Claim 8, wherein the at least one portion of bitstream data comprises a key frame, and pref- 
erably the bitstream comprises MPEG data and the at least one portion of bitstream data comprises an intra-frame. 

10. A table according to Claim 8 or 9, wherein the bitstream comprises at least one further portion of bitstream data 
which can be used to regenerate a portion of audiovisual data in conjunction with the at least one portion of bitstream 

20 data, and preferably the at least one further portion of bitstream data comprises a delta frame. 

11. A table according to any of Claims 2 to 1 0, wherein the decoding data comprises a plurality of pieces of decoding 
data, each adapted to decode a respective portion of the encoded representation of the bitstream. 

25 12. A table according to any of Claims 2 to 11 , wherein the table comprises a plurality of records each mapping a 
respective data offset in a file containing a representation of a bitstream to a corresponding time offset in the 
bitstream, and each record is mapped to respective decoding data for decoding a respective portion of the encoded 
representation of the bitstream. 

30 13. A table according to any of Claims 1 to 12, wherein the representation of the bitstream comprises at least one 
piece of data mapping to decoding data. 

14. A table according to any of Claims 2 to 13, wherein the decoding data comprises, or is included in, at least one 
further record, and preferably the said at least one further record comprises conditional access information or 

35 content management information. 

15. A table according to any of Claims 1 to 14, wherein the table is generated automatically during recordal of the 
representation of the bitstream in the file. 

40 16. A table according to any of Claims 1 to 15, wherein at least one record is mapped to at least one further record, 
and preferably the said at least one further record is stored in a further table, and/or the said at least one further 
record is inserted upon command of a user, and/or the said at least one record in the table is mapped to the 
respective at least one further record upon command of a user. 

45 17. a table according to any of Claims 1 to 1 6, comprising at least one record inserted in dependence upon a char- 
acteristic of the bitstream and/or at least one record inserted upon command of a user. 

18. A table according to any of Claims 1 to 17, wherein at least one record comprises a first data point representing 
a respective data offset and a second data point representing a corresponding time offset. 

50 

19. A table according to any of Claims 1 to 18, wherein at least one record is inserted automatically. 

20. A table according to any of Claims 1 to 1 9 adapted for storage in a file with the representation of the bitstream. 

55 21. A table comprising at least one record mapping a respective data offset in a file containing a representation of a 
bitstream to a corresponding time offset in the bitstream. 

22. A method of facilitating the searching of a file containing a representation of a bitstream, comprising generating a 
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table according to any of Claims 1 to 21 . 

23. A method according to Claim 22, further comprising storing the table in a file, preferably in the file containing the 
representation of the bitstream. 

24. A method of searching a file containing a representation of a bitstream for a desired portion of data, comprising 
the steps of jumping to a position in the file, and reading data from that position. 

25. A method according to Claim 24, wherein the step of reading data comprises reading data until the desired portion 
of data is found and/or reading a fixed amount of data and/or reading an amount of data representative of a fixed 
period of time and/or reading data until a particular piece of data is read. 

26. A method according to any of Claims 22 to 25, wherein the bitstream is a variable bitrate bitstream. 

27. A method according to any of Claims 24 to 26, wherein the desired portion of data is representative of bitstream 
data which can independently be used to regenerate a portion of audiovisual data 

28. A method according to any of Claims 24 to 27, wherein the step of jumping to a position in the file comprises 
reading a record from a table according to any of Claims 1 to 21 and jumping to the data offset given in the record, 
and preferably the data offset in the record corresponds to the desired position in the file. 

29. A method according to any of Claims 24 to 28, wherein the step of reading data comprises decoding the data, and 
preferably comprises reading a record from a table according to any of Claims 2 to 21 and decoding the data using 
the decoding data. 

30. A method according to any of Claims 24 to 29, wherein :- 

the step of jumping to a position in the file comprises reading a record from a table according to any of Claims 

1 6 and jumping to the data offset given in the record; and 

the at least one further record is used in the step of reading data. 

31. A method of searching a file containing a representation of a bitstream for a plurality of desired portions of data, 
comprising searching for each desired portion of data using a method according to any of Claims 24 to 30, and 
preferably the desired portions of data are representative of portions of bitstream data which are periodically spaced 
in time. 

32. A method according to Claim 31 , wherein the desired portions of data are used to effect a fast forwarding or 
rewinding operation, and preferably the time period between the portions of bitstream data represented by the 
desired portions of data is chosen to effect a given fast-forwarding or rewinding speed. 

33. A method according to Claim 31 or 32, wherein the time period between the portions of bitstream data represented 
by the desired portions of data is chosen in dependence upon a characteristic of a means used to carry out the 
method. 

34. A method according to Claim 33, wherein the characteristic is the maximum sustainable rate of retrieval or process- 
ing of data from the file and/or the characteristic is a read/write hard disk access time, or a parsing demultiplexer 
bandwidth, or an operating system scheduling accuracy. 

35. A method according to any of Claims 32 to 34, wherein the given fast-forwarding or rewinding speed is varied upon 
command of a user. 

36. A method of retrieving at least one desired portion of data from a file containing a representation of a bitstream, 
comprising searching for the desired portion of data using a method according to any of Claims 24 to 35, and 
retrieving the desired portion of data. 

37. A method according to Claim 36 for retrieving a plurality of desired portions of data from a file, comprising searching 
for each desired portion of data using a method according to any of Claims 24 to 35, and retrieving each desired 
portion of data in turn. 
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38. A method of outputting data, comprising retrieving at least one desired portion of data from a file containing a 
representation of a bitstream using a method according to Claim 36, and outputting the at least one desired portion 
of data. 

39. A method of outputting data, comprising retrieving a plurality of desired portions of data using a method according 
to Claim 36 or 37, and outputting each desired portion of data in turn. 

40. A method of outputting data according to Claim 39, wherein each of the plurality of desired portions of data is 
representative of a respective portion of bitstream data, and the respective portions of bitstream data are period- 
ically spaced in time and/or have the same duration. 

41. A method of effecting a fast forwarding or rewinding operation comprising outputting data according to Claim 39 
or 40. 

42. A file, comprising a representation of a bitstream, and a table as claimed in any of Claims 1 to 21 . 

43. A processor for generation of a table according to any of Claims 1 to 21 and/or for analysis of characteristics of a 
bitstream and insertion of records in a table according to any of Claims 1 to 21 in dependence upon this analysis. 

44. A storage means for storage of a table according to any of Claims 1 to 21 . and preferably for storage of a file 
containing a representation of a bitstream. 

45. A hard disk video recorder comprising a storage means according to Claim 44 and preferably further comprising 
a processor according to Claim 43. 

46. A receiver/decoder comprising a hard disk video recorder according to Claim 45, and/or adapted to communicate 
with a hard disk video recorder according to Claim 45. 

47. A broadcast system incorporating a receiver/decoder according to Claim 46. 

48. A computer program product adapted to carry out a method according to any of Claims 22 to 41 . 

49. A computer readable medium having stored thereon a computer program product as claimed in Claim 48, and/or 
having stored thereon a table according to any of Claims 1 to 21 . 

50. A signal tangibly embodying a computer program product as claimed in Claim 49. 

51. A method of transmitting a signal as claimed in Claim 50. 

52. Apparatus for evaluating a position in a bit stream, comprising means for estimating the position. 

53. Apparatus according to Claim 52, wherein the means for estimating the position is adapted to estimate the position 
in dependence on a known position in the bit stream. 

54. Apparatus according to Claim 53, further comprising means for selecting the known position from a plurality of 
alternatives. 

55. Apparatus according to Claim 54, wherein the means for selecting the known position is adapted to select the 
known position in dependence on its proximity to the position to be evaluated. 

56. Apparatus according to Claim 54 or 55, wherein the means for selecting the known position is adapted to select 
systematically one of the two known positions closest to the position to be evaluated and/or to select the known 
position as a transition in the bit stream between a first and second portion of the bit stream. 

57. Apparatus for manipulating a bit stream, comprising means for receiving conditional access data, means for syn- 
chronising the conditional access data with the bit stream, and means for storing the bit stream. 

58. Apparatus according to Claim 57, wherein the means for synchronising is adapted to create a reference between 
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the conditional access data and a corresponding position in the bit stream, and is preferably adapted to select the 
referenced position such that it falls within a portion of the bit stream to which the conditional access data corre- 
sponds. 

5 59. Apparatus according to Claim 58, wherein the means for synchronising is adapted to select the referenced position 
in dependence on an event signifying the receipt of the conditional access data by the receiving means. 

60. Apparatus according to Claim 58 or 59, further comprising means for estimating a position in the bit stream, and 
wherein the referenced position is selected in dependence on the estimated position. 

10 

61 . Apparatus for manipulating a bit stream, comprising means for transferring the bit stream in a plurality of discrete 
segments, and means for estimating a position in the bit stream in dependence on a property of one of the seg- 
ments. 

15 62. Apparatus according to Claim 61 , further comprising means for predetermining the size of a segment, preferably 
adapted to predetermine a size equivalent to less than a portion of the bit stream associated with the position. 

63. Apparatus according to Claim 61 or 62, wherein the means for predetermining the size is adapted to predetermine 
the size in dependence on a characteristic of the bit stream. 

20 

64. A command for controlling the transfer of an audio/visual bit stream, wherein the transfer speed is represented as 
a parameter. 

65. A command according to Claim 64, wherein the speed is positive, zero and/or negative and/or is related to the 
25 parameter by a multiple of a normal transfer speed. 

66. A command according to Claim 64 or 65, wherein a position at which the transfer is to take place is represented 
as a parameter. 

30 67. A command for controlling the transfer of an audio/visual bit stream, wherein the position at which the transfer is 
to take place is represented as a parameter. 

68. A command according to Claim 66 or 67, wherein the parameter specifying the position at which the transfer is to 
take place is related to a measure of time and/or is related to an offset in the bit stream. 

35 

69. A command set, comprising at least one command as claimed in any of the Claims 64 to 68. 

70. A command for controlling the transfer of an audio/visual bit stream, the command adapted to invoke at least one 
command as claimed in any of Claims 64 to 68. 

40 

71 . A command according to Claim 70, adapted to selectively invoke different further commands in dependence on a 
state relating to the transfer of the audio/visual bit stream. 

72. A command according to Claim 70 or 71 , adapted to cause the or a further audio/visual bitstream to be stored. 

45 

73. A command for controlling the transfer of an audio/visual bit stream, the command adapted to invoke at least one 
command as claimed in any of Claims 70 to 72. 

74. A command as claimed in any of Claims 64 to 68 and 70 to 73, wherein the command corresponds to a user- 
50 selectable audio/visual control operation. 

75. A method of controlling the transfer of an audio/visual bitstream, comprising comparing a command according to 
any of Claims 64 to 68 or 70 to 74 to a control criterion, and generating a further command in dependence upon 
whether the command matches the control criterion. 

55 

76. A method according to Claim 75, wherein the command is a further command generated according to Claim 75. 

77. A method according to Claim 75 or 76, wherein the control criterion is dependent upon a characteristic of the 
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transfer of the audio/visual bitstream, preferably of the transfer occurring at the time of receipt of the command. 

78. An index table comprising indices mapping time offsets in a bitstream to data offsets in a file. 

79. An index table according to Claim 78, wherein the index table is a table according to any of Claims 1 to 21 . 

80. A hard disk video recorder (HDVR) adapted to receive a command from a client in response to a user input. 

81. A hard disk video recorder (HDVR) according to Claim 80, further adapted to receive a command to start recording 
a particular programme. 

82. A hard disk video recorder (HDVR) according to Claim 80 or 81 , further adapted to interact with a device, preferably 
a service device, and/or to interact with a file system library. 

83. A hard disk video recorder (HDVR) according to Claim 82, adapted to send or receive a further command, in order 
to interact with the service device and/or the file system library. 

84. A hard disk video recorder (HDVR) according to any of Claims 80 to 83, wherein the command or the further 
command causes the generation of a further command, and preferably the further command is a command ac- 
cording to any of Claims 64 to 68, or 70 to 74. 
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FIG. 11 
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